-- Logs begin at Thu 2022-08-25 04:20:58 UTC, end at Thu 2022-08-25 05:41:40 UTC. -- Aug 25 05:04:31.646889 dv-cinder-853910-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 05:04:31.656446 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 05:04:31 2022] *** Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: nodename: dv-cinder-853910-2-iscsi Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: machine: x86_64 Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: clock source: unix Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: pcre jit disabled Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: detected number of CPU cores: 4 Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: current working directory: / Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: detected binary path: /usr/bin/uwsgi-core Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: your processes number limit is 47680 Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: your memory page size is 4096 bytes Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: detected max file descriptor number: 2048 Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: lock engine: pthread robust mutexes Aug 25 05:04:31.657776 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: thunder lock: enabled Aug 25 05:04:31.658619 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 05:04:31.658619 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 05:04:31.697258 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: Python main interpreter initialized at 0x5610444199c0 Aug 25 05:04:31.697258 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: python threads support enabled Aug 25 05:04:31.697258 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: your server socket listen backlog is limited to 100 connections Aug 25 05:04:31.697258 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: your mercy for graceful operations on workers is 90 seconds Aug 25 05:04:31.697624 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 05:04:31.697725 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: *** Operational MODE: preforking *** Aug 25 05:04:31.697946 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: *** uWSGI is running in multiple interpreter mode *** Aug 25 05:04:31.697946 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: spawned uWSGI master process (pid: 106271) Aug 25 05:04:31.698139 dv-cinder-853910-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 05:04:31.698691 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: spawned uWSGI worker 1 (pid: 106272, cores: 1) Aug 25 05:04:31.699716 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: spawned uWSGI worker 2 (pid: 106273, cores: 1) Aug 25 05:04:31.699716 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 05:04:32.354310 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 05:04:32.361369 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 05:04:33.429946 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:04:33.429946 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: from cryptography.utils import int_from_bytes Aug 25 05:04:33.430622 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:04:33.430622 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: from cryptography.utils import int_from_bytes Aug 25 05:04:33.433110 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:04:33.433110 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: from cryptography.utils import int_from_bytes Aug 25 05:04:33.433548 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:04:33.433548 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: from cryptography.utils import int_from_bytes Aug 25 05:04:35.880398 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:04:35.880967 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:04:35.881067 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:04:35.881424 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:04:35.881510 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:04:35.881616 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:04:35.881758 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:04:35.881858 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:04:35.882138 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.882236 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:04:35.882453 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:04:35.882566 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.882768 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.882861 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.883077 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.883174 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.883400 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.883487 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.883705 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.883805 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.884026 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.884178 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.884337 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.884440 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.884660 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.884765 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.884914 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.885007 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.885222 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.885308 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.885540 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-2-iscsi {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.885664 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.885885 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.886004 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.886188 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.886286 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-2-iscsi {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.886493 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.886591 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.886807 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.886902 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.887107 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.887208 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.887425 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.887519 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.887725 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.887827 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.888047 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.888219 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.888354 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.888662 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.888927 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.889535 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.889775 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.889882 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.890087 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.890293 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.890463 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.890560 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.890718 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.890827 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.891033 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.891120 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.891344 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.891434 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.891665 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.891756 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.891970 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.892056 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.892289 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.892373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-2-iscsi {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.892598 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.892719 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.892950 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.893091 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-2-iscsi {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.893258 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.893352 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.893617 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.893705 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.893938 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.894084 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.894274 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.894361 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.894591 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.894685 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.894911 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.894997 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.895214 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.895308 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.895534 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.895620 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.895852 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.895994 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.896164 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.896268 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.896478 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.896577 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.896775 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.896868 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.897080 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.897175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.897382 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.897478 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.897717 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.897823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898017 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898116 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898315 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898408 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898558 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898644 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898860 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.898957 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.899160 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.899254 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.899471 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.899556 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.899784 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.899872 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900030 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900123 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900274 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900412 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900585 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900672 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900900 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.900985 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.901200 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.901293 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.901503 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.901610 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.901828 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.901914 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.902128 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.902216 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.902429 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.902515 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.902727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.902814 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.903028 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.903117 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.903327 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.903413 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.903635 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.903718 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.903941 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.904025 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.904256 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.904348 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.904586 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.904671 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.904902 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.904996 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.905209 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.905296 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.905526 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.905710 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.905951 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.906086 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.906227 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.906370 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.906537 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.906641 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.906883 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.906973 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.907194 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.907277 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.907503 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.907603 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.907805 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.907890 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.908108 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.908194 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.908410 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.908504 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.908731 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.908842 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.909039 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.909130 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.909353 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.909453 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.909630 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.909747 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.909913 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.910008 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.910214 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.910309 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.910529 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.910619 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.910829 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.910912 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.911135 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.911221 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.911437 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.911522 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.911732 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.911819 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.912031 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.912117 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.912332 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.912426 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.912632 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.912716 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.912935 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.913028 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.913236 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.913321 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.913533 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.913651 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.913855 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.913942 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.914155 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.914239 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.914455 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.914553 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.914758 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.914841 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.915061 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.915147 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.915360 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.915452 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.915660 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.915747 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.915960 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.916115 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.916264 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.916355 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.916563 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.916652 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.916864 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.916950 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.917164 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.917258 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.917472 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.917573 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.917795 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.917880 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.918094 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.918192 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.918405 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.918490 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.918708 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.918804 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.919010 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.919106 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.919317 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.919401 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.919610 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.919702 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.919929 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.920021 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.920257 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.920351 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.920564 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.920659 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.920883 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.920976 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.921195 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.921284 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.921500 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.921666 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.921819 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.921906 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.922119 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.922204 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.922416 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.922501 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.922713 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.922799 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923008 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923093 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923312 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923404 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923613 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923700 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923915 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.923999 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.924216 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.924300 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.924513 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.924600 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.924826 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.924919 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.925130 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.925228 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.925453 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:04:35.925552 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.925813 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.925900 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.926122 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.926222 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.926452 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.926580 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.926777 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.926871 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.927089 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.927183 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.927398 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.927483 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.927709 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.927795 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.928028 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.928113 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.928333 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.928424 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.928639 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.928731 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.928945 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.929042 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.929257 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.929343 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.929568 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.929665 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.929912 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.930019 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.930222 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.930315 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.930533 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.930618 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.930841 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.930931 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.931144 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.931231 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.931456 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.931549 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.931766 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.931853 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.932086 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.932172 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.932388 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.932475 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.932724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.932810 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.933037 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.933122 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.933354 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.933447 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.933702 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.933795 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.934021 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.934107 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.934328 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.934429 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.934632 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.934719 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.934938 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.935024 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.935252 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.935344 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.935565 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.936155 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.936412 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.936497 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.936730 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.936828 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.937039 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.937133 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.937360 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.937451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.937693 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.937829 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.938004 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.938097 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.938312 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.938398 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.938619 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.938705 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.938926 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.939019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.939245 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.939338 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.939554 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.939640 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.939873 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.939959 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.940183 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.940279 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.940492 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.940579 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.940808 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.940893 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.941118 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.941215 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.941436 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.941527 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.941768 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.941877 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.942073 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.942170 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.942374 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.942467 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.942675 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.942761 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.942980 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.943074 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.943283 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.943369 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.943596 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.943679 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.943906 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.944001 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.944208 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.944294 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.944537 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.944623 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.944840 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.944942 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.945148 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.945235 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.945456 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.945548 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.945787 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.945876 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.946088 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.946181 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.946399 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.946486 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.946705 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.946843 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.947005 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.947091 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.947321 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.947412 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.947627 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.947713 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.947929 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.948016 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.948248 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.948334 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.948548 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.948642 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.948849 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.948947 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.949159 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.949254 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.949468 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.949554 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.949801 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.949887 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.950110 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.950208 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.950417 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.950505 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.950732 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.950817 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.951037 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.951131 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.951928 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.952034 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.952256 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.952343 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.952577 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.952664 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.952905 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.952990 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.953228 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.953320 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.953533 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.953688 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.953872 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.953957 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.954172 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.954258 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.954479 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.954566 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.954781 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.954867 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.955083 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.955177 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.955383 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.955470 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.955688 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.955773 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.955984 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.956075 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.956284 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.956372 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.956588 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.956679 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.956887 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.956980 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.957186 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.957279 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.957488 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.957574 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.957819 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.957918 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.958119 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.958205 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.958420 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.958513 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.958720 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.958814 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.959030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.959123 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.959336 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.959422 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.959671 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.959763 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.959976 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.960062 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.960304 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.960388 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.960625 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.960714 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.960935 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.961028 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.961246 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.961339 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.961554 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.961670 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.961882 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.961976 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.962189 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.962275 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.962497 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.962592 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.962807 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.962899 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.963114 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.963200 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.963430 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.963517 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.963737 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.963830 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.964058 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.964151 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.964363 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.964448 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.964679 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.964764 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.964980 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.965118 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.965291 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.965379 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.965636 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.965727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.965933 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.966293 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.966535 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.966619 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.966854 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.966950 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.967195 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.967293 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.967506 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.967590 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.967813 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.967899 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.968122 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.968219 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.968430 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.968524 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.968738 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.968824 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.969052 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.969138 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.969359 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.969444 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.969700 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.969792 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.970008 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.970103 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.970327 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.970412 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.970630 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.970723 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.970944 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.971043 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.971245 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.971338 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.971559 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.971683 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.971865 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.971956 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.972182 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.972267 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.972484 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.972577 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.972792 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.972890 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.973107 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.973195 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.973411 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.973506 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.973738 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.973838 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.974046 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.974133 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.974347 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.974441 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.974649 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.974735 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.974952 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.975084 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.975258 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.975351 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.975558 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.975657 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.975865 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.975951 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.976165 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.976252 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.976473 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.976558 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.976779 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.976883 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.977090 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.977231 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.977378 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.977473 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.977705 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.977796 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.978008 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.978095 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.978321 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.978406 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.978641 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.978727 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.978954 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.979041 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.979252 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.979337 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.979552 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.979644 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.979872 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.979969 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.980176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.980261 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.980475 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.980568 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.980775 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.980862 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.981076 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.981225 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.981388 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.981487 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.981727 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.981815 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.982028 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.982125 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.982340 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.982436 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.982681 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.982775 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.982987 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.983073 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.983297 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.983393 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.983603 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.983687 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.983907 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.984002 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.984217 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.984311 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.984526 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.984618 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.984829 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.984916 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.985137 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.985224 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.985442 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.985528 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.985773 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.985863 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.986079 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.986167 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.986391 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.986484 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.986696 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.986781 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.987007 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.987122 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.987314 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.987424 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.987614 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.987708 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.987920 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.988005 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.988225 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.988312 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.988539 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.988783 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.988876 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.989118 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.989420 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.989507 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.989763 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.989939 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.990085 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.990172 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.990405 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.990490 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.990727 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.990822 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.991052 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.991144 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.991362 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.991458 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.991665 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.991759 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.991972 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.992070 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.992277 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.992370 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.992579 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.992665 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.992886 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.992980 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.993189 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.993282 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.993490 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.993679 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.993814 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.993918 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.994121 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.994214 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.994417 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.994502 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.994719 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.994814 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.995019 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.995104 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.995320 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.995413 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.995624 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.995711 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.995922 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.996006 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.996232 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.996316 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.996537 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.996635 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.996848 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.996934 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.997154 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.997251 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.997457 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.997544 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.997782 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.997870 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.998084 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.998679 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.998917 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.999003 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.999227 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.999326 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.999558 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.999651 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.999870 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:35.999955 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.000208 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.000302 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.000510 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.000602 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.000811 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.000898 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.001131 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.001216 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.001433 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.001520 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.001756 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.001848 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.002057 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.002153 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.002363 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.002450 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.002668 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.002754 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.002967 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.003055 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.003273 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.003367 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.003577 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.003709 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.003881 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.003968 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.004185 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.004280 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.004486 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.004573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.004791 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.004885 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.005092 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.005180 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.005399 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.005485 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.005723 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.005832 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.006023 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.006117 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.006326 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.006412 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.006627 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.006720 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.006929 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.007014 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.007234 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.007354 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.007542 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.007638 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.007835 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.007922 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.008145 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.008231 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.008443 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.008535 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.008743 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.008836 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.009040 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.009128 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.009344 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.009432 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.009667 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.009754 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.009970 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.010064 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.010277 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.010364 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.010582 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.010674 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.010881 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.010966 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.011181 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.011275 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.011484 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.011571 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.011783 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.011870 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.012082 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.012169 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.012386 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.012471 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.012693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.012788 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.013002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.013088 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.013301 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.013387 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.013626 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.014411 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.014496 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.014566 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.014771 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.014858 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.015069 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.015165 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.015373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.015456 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.015668 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.015754 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.015965 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.016052 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.016261 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.016353 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.016562 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.016656 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.016855 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.016941 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.017155 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.017305 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.017457 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.017551 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.017778 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.017865 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.018075 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.018163 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.018373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.018458 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.018683 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.018770 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.018992 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.019078 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.019337 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.019432 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.019635 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.019720 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.019944 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.020036 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.020255 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.020353 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.020561 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.020647 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.020888 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.020973 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.021203 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.021297 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.021516 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.021651 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.021852 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.021946 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.022157 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.022251 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.022463 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.022547 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.022761 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.022846 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.023059 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.023153 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.023362 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.023447 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.023665 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.023751 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.023969 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.024055 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.024283 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.024368 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.024597 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.024690 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.024913 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.025007 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.025212 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.025305 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.025516 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.025660 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.025846 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.025941 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.026150 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.026237 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.026459 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.026543 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.026761 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.027068 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.027162 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.027373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.027510 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.027680 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.027802 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.027988 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.028075 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.028294 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.028389 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.028596 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.028682 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.028900 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.028986 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.029206 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.029300 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.029531 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.029651 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.029869 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.029965 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.030171 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.030266 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.030470 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.030563 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.030773 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.030865 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.031072 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.031159 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.031377 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.031462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.031674 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.031765 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.031982 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.032091 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.032286 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.032398 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.032704 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.032792 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.033005 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.033093 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.033309 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.033397 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.033631 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.033731 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.033945 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.034031 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.034254 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.034340 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.034553 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.034648 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.034871 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.034960 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.035178 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.035265 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.035560 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.035653 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.035868 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.035954 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.036168 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.036254 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.036473 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.036568 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.036780 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.036866 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.037089 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.037173 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.037387 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.037487 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.037713 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.037814 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.038013 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.038099 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.038330 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.038416 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.038626 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.038711 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.038941 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.039026 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.039243 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.039355 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.039568 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.039654 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.039948 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.040032 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.040289 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.040381 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.040598 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.040685 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.040942 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.041026 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.041259 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.041346 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.041576 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.041715 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.041924 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.042023 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.042223 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.042310 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.042533 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.042663 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.042838 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.042933 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.043157 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.043252 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.043466 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.043551 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.043771 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.043856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.044080 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.044174 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.044399 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.044494 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.044696 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.044790 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.045000 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.045094 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.045332 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.045418 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.045678 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.045769 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.045999 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.046098 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.046328 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.046414 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.046697 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.046783 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.047016 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.047104 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.047336 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.047429 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.047636 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.047723 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.047935 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.048022 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.048240 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.048326 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.048540 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.048626 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.048840 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.048926 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.049158 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.049244 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.049456 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.049542 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.049787 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.049877 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.050094 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.050181 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.050401 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.050495 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.050698 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.050785 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.050996 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.051089 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.051303 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.051403 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.051600 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.051697 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.051916 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.052003 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.052219 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.052319 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.052533 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.052619 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.052847 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.052932 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.053144 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.053275 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.053463 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.053551 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.053793 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.053888 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.054095 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.054182 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.054399 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.054486 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.054700 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.054793 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.055006 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.055092 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.055314 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.055407 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.055634 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.055719 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.055957 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.056048 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.056280 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.056366 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.056591 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.056677 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.056924 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.057012 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.057235 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.057328 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.057551 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.057741 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.057889 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.057983 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.058207 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.058294 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.058507 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.058602 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.058808 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.058894 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.059116 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.059208 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.059416 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.059512 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.059717 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.059805 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.060016 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.060103 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.060319 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.060482 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.060616 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.061211 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.061440 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.061527 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.061764 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.061856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.062074 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.062159 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.062375 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.062467 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.062695 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.062823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.062999 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.063084 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.063299 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.063385 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.063601 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.063689 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.063900 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.063986 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.064210 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.064295 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.064519 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.064606 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.064841 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.064934 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.065160 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.065258 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.065470 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.065558 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.065809 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.065910 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.066122 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.066224 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.066436 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.066524 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.066751 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.066840 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.067067 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.067160 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.067377 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.067464 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.067689 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.067819 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.067996 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.068162 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.068309 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.068403 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.068622 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.068707 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.068933 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.069020 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.069250 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.069446 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.069578 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.069798 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.070112 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.070199 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.070421 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.070508 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.070728 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.070814 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.071039 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.071126 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.071350 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.071436 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.071656 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.071743 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.071965 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.072052 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.072271 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.072365 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.072577 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.072672 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.072889 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.072982 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.073206 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.073301 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.073525 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.073665 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.073877 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.073963 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.074189 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.074275 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.074501 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.074589 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.074812 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.074905 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.075121 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.075208 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.075438 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.075524 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.075755 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.075841 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.076055 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.076194 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.076914 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.077012 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.077238 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.077325 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.077548 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.077666 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.077878 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.078009 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.078186 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.078273 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.078494 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.078594 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.078801 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.078896 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.079108 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.079196 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.079412 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.079499 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.079718 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.079807 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.080025 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.080111 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.080336 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.080422 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.080652 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.080748 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.080966 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.081052 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.081276 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.081363 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.081618 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.081710 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.081916 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.082017 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.082240 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.082429 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.082559 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.082739 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.083068 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.083163 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.083383 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.083469 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.083703 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.083789 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.084014 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.084108 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.084327 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.084413 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.084648 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.084734 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.084949 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.085047 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.085249 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.085343 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.085555 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.085661 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.085882 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.085971 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.086183 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.086268 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.086493 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.086585 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.086800 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.086886 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.087108 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.087196 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.087424 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.087508 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.087728 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.087813 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.088049 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.088256 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.088364 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.088597 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.088904 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.088992 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.089223 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.089317 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.089549 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.089668 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.089885 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.089973 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.090190 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.090284 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.090510 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.090605 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.090814 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.090907 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.091377 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.091467 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.091689 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.091788 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.092022 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.092112 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.092325 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.092410 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.092626 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.092726 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.092934 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.093021 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.093240 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.093328 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.093537 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.093659 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.093867 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.093955 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.094171 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.094299 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.094484 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.094615 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.094787 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.094873 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.095089 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.095176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.095389 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.095477 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.095696 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.095783 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.095997 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.096082 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.096298 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.096385 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.096599 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.096692 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.096898 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.096993 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.097202 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.097287 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.097499 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.097603 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.097835 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.098001 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.098145 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.098235 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.098455 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.098543 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.098759 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.098855 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.099063 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.099156 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.099367 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.099457 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.099682 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.099778 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.100004 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.100091 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.100302 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.100395 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.100612 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.100700 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.100918 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.101012 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.101230 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.101323 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.101537 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.101670 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.101868 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.101955 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.102189 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.102274 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.102504 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.102592 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.102855 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.103030 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.103174 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.103365 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.103687 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.103774 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.104020 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.104106 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.104350 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.104449 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.104656 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.104744 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.104961 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.105047 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.105263 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.105358 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.105601 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.105691 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.105913 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.106000 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.106223 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.106321 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.106531 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.106618 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.106839 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.106925 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.107152 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.107239 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.107460 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.107571 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.107792 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.107880 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.108100 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.108225 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.108408 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.108498 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.108711 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.108797 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.109015 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.109103 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.109320 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.109408 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.109645 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.109750 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.109954 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.110042 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.110266 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.110351 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.110582 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.110681 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.110901 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.110989 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.111214 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.111299 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.111528 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.111623 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.111842 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.111930 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.112152 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.112238 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.112457 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.112552 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.112762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.112849 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.113067 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.113153 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.113375 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.113461 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.113720 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.113808 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.114032 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.114117 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.114335 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.114423 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.114666 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.114751 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.114978 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.115064 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.115344 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.115430 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.115662 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.115749 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.115971 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.116066 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.116291 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.116379 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.116611 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.116706 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.116919 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.117015 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.117240 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.117327 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.117548 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.117663 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.117894 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.117997 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.118211 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.118345 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.118543 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.118638 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.118865 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.118953 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.119169 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.119264 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.119470 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.119557 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.119770 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.119858 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.120076 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.120171 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.120392 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.120488 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.120697 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.120792 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.120999 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.121085 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.121299 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.121394 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.121622 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.121712 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.121934 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.122034 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.122248 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.122347 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.122557 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.122645 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.122865 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.123020 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.123704 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.123869 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.124015 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.124173 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.124328 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.124475 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.124635 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.124777 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.124942 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.125079 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.125249 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.125380 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.125556 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.125702 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.125903 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.126009 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.126211 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.126297 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.126524 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.126612 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.126832 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.126926 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.127141 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.127228 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.127447 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.127537 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.127753 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.127847 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.128059 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.128145 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.128395 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.128520 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.128712 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.128797 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.129019 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.129114 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.129340 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.129433 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.129675 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.129766 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.129994 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.130092 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.130309 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.130394 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.130661 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.130801 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.130923 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.131020 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.131249 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.131337 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.131556 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.131643 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.131865 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.131962 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.132174 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.132264 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.132480 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.132568 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.132788 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.132876 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.133094 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.133223 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.133405 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.133498 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.133743 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.133868 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.134048 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.134135 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.134370 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.134468 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.134685 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.134774 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.135001 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.135097 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.135312 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.135408 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.135619 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.135706 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.135936 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.136021 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.136240 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.136339 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.136548 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.136643 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.136853 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.136946 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.137160 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.137261 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.137475 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.137618 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.137806 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.137911 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.138117 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.138206 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.138427 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.138516 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.138739 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.138869 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.139603 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.139693 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.139930 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.140024 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.140249 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.140336 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.140582 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.140676 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.140908 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.140994 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.141219 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.141313 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.141551 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.141693 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.141888 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.142012 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.142233 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.142338 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.142548 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.142634 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.142858 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.142950 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.143167 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.143308 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.143472 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.143561 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.143712 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:04:36.143820 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.144128 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:04:36.144369 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:04:36.296635 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO dbcounter [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Registered counter for database nova_api Aug 25 05:04:36.296839 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO dbcounter [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Registered counter for database nova_api Aug 25 05:04:36.317483 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_db.sqlalchemy.engines [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.320834 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_db.sqlalchemy.engines [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.324385 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writer thread running {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.327916 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writer thread running {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.380775 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.context [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f327c0d-26cd-440b-94ed-9780c2c19efc(cell1) {{(pid=106273) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:04:36.382775 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.context [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f327c0d-26cd-440b-94ed-9780c2c19efc(cell1) {{(pid=106272) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:04:36.384604 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:04:36.385086 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:04:36.386609 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_concurrency.lockutils [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:04:36.386756 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:04:36.387083 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_concurrency.lockutils [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:04:36.387412 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:04:36.387858 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:04:36.388661 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_concurrency.lockutils [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:04:36.389931 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_concurrency.lockutils [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:04:36.390354 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:04:36.390458 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_concurrency.lockutils [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:04:36.392346 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_concurrency.lockutils [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:04:36.392449 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO dbcounter [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Registered counter for database nova_cell0 Aug 25 05:04:36.394354 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO dbcounter [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Registered counter for database nova_cell0 Aug 25 05:04:36.397997 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO dbcounter [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Registered counter for database nova_cell1 Aug 25 05:04:36.399719 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO dbcounter [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Registered counter for database nova_cell1 Aug 25 05:04:36.406160 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_db.sqlalchemy.engines [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.407883 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_db.sqlalchemy.engines [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.409695 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_db.sqlalchemy.engines [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.411176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writer thread running {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.411830 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_db.sqlalchemy.engines [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.416572 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writer thread running {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.418120 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writer thread running {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.550486 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writer thread running {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.559034 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO dbcounter [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Registered counter for database nova_cell0 Aug 25 05:04:36.563759 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO dbcounter [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Registered counter for database nova_cell0 Aug 25 05:04:36.566680 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_db.sqlalchemy.engines [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.571125 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writer thread running {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.572210 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG oslo_db.sqlalchemy.engines [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:04:36.577221 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writer thread running {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:04:36.992469 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: WARNING keystonemiddleware.auth_token [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:04:37.000339 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: WARNING keystonemiddleware.auth_token [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:04:37.016398 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: WARNING keystonemiddleware.auth_token [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:04:37.023562 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: WARNING keystonemiddleware.auth_token [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:04:37.341456 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: WARNING keystonemiddleware.auth_token [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:04:37.347899 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: WARNING keystonemiddleware.auth_token [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:04:37.353114 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5610444199c0 pid: 106273 (default app) Aug 25 05:04:37.355212 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:04:37.356404 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 25 05:04:37.356816 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu Aug 25 05:04:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:04:37.363176 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: WARNING keystonemiddleware.auth_token [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:04:37.369088 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: WARNING keystonemiddleware.auth_token [None req-1194f733-52e5-4a5a-b1ee-fcaa1c75752c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:04:37.374799 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5610444199c0 pid: 106272 (default app) Aug 25 05:05:57.632114 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:05:57.633118 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 25 05:05:57.633713 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:05:57.650625 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writing DB stats nova_api:SELECT=3 {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:57.651788 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writing DB stats nova_cell0:SELECT=3 {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:57.652851 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writing DB stats nova_cell1:SELECT=3 {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:57.654036 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:05:58.508024 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-0c87a2c1-b08a-4e87-86f5-c4b1b7e621d5 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:05:58.540149 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-0c87a2c1-b08a-4e87-86f5-c4b1b7e621d5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.898994 Aug 25 05:05:58.540698 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Aug 25 05:05:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:06:00.894467 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:00.895536 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-2450d4b3-0e4a-4690-9799-1b21da7e33e6 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 25 05:06:00.904489 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:01.343355 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-9b08f688-9310-481c-8a16-8688f5c5180a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "disk": 1, "swap": 0, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:01.520046 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-9b08f688-9310-481c-8a16-8688f5c5180a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.615336 Aug 25 05:06:01.520639 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:06:01.543298 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_api:SELECT=3 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:01.543298 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_cell0:SELECT=3 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:01.543298 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_cell1:SELECT=3 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:01.543298 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:01.753997 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-e416c00c-d9f3-4ab6-aaf5-aaaeee21b114 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:01.903252 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-e416c00c-d9f3-4ab6-aaf5-aaaeee21b114 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.373228 Aug 25 05:06:01.909995 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Aug 25 05:06:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:06:04.222619 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-9b08f688-9310-481c-8a16-8688f5c5180a admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:04.224896 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-9b08f688-9310-481c-8a16-8688f5c5180a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002716 Aug 25 05:06:04.225801 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:04.864140 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-89f58325-f66b-4bc9-a324-a48ac7a8eb6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:04.984014 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-89f58325-f66b-4bc9-a324-a48ac7a8eb6f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.751585 Aug 25 05:06:04.987408 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:04.997798 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-e82e83c1-557c-4887-b9db-26fafdbc8e46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:05.110825 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-e82e83c1-557c-4887-b9db-26fafdbc8e46 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117635 Aug 25 05:06:05.111414 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Aug 25 05:06:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:07.440626 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-89f58325-f66b-4bc9-a324-a48ac7a8eb6f admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:07.441788 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-89f58325-f66b-4bc9-a324-a48ac7a8eb6f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Aug 25 05:06:07.442101 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:07.833547 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-80a83cec-b0da-4928-82a4-3bd81c93065b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:07.902445 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-80a83cec-b0da-4928-82a4-3bd81c93065b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454410 Aug 25 05:06:07.903355 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:07.915408 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-6dea9b9e-cc66-4ff0-aed0-6c2fe6f88de5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:07.985545 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-6dea9b9e-cc66-4ff0-aed0-6c2fe6f88de5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073985 Aug 25 05:06:07.986162 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Aug 25 05:06:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:10.347214 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-80a83cec-b0da-4928-82a4-3bd81c93065b admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:10.348679 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-80a83cec-b0da-4928-82a4-3bd81c93065b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Aug 25 05:06:10.348935 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:10.777992 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-290a2c0c-12fb-4857-9752-837b8947ba78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:10.851599 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-290a2c0c-12fb-4857-9752-837b8947ba78 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496084 Aug 25 05:06:10.852393 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:06:10.864402 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-2ce442bf-9fa8-41da-a286-06e2e0b89df0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:10.935234 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-2ce442bf-9fa8-41da-a286-06e2e0b89df0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074498 Aug 25 05:06:10.936154 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Aug 25 05:06:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:13.290512 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-290a2c0c-12fb-4857-9752-837b8947ba78 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:13.292095 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-290a2c0c-12fb-4857-9752-837b8947ba78 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Aug 25 05:06:13.292659 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:13.733797 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-d2694287-057f-4131-a856-82ab0d1e22c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:13.832180 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-d2694287-057f-4131-a856-82ab0d1e22c9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533398 Aug 25 05:06:13.832975 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:13.846500 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-bddde780-de5f-4fe0-a242-311d06bbc20e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:14.140624 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-bddde780-de5f-4fe0-a242-311d06bbc20e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297821 Aug 25 05:06:14.145951 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Aug 25 05:06:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:16.813494 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-d2694287-057f-4131-a856-82ab0d1e22c9 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:16.814458 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-d2694287-057f-4131-a856-82ab0d1e22c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 25 05:06:16.814862 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:17.344008 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-fea0ab6f-e1d0-46c1-a7f3-8289730cca29 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:17.377216 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-fea0ab6f-e1d0-46c1-a7f3-8289730cca29 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.556106 Aug 25 05:06:17.377976 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Aug 25 05:06:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:06:19.709252 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-d2694287-057f-4131-a856-82ab0d1e22c9 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:19.710371 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-d2694287-057f-4131-a856-82ab0d1e22c9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 25 05:06:19.710777 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:20.119356 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-a4e5e241-bfed-4c4b-bb56-067442fd046d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:20.210633 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-a4e5e241-bfed-4c4b-bb56-067442fd046d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.493096 Aug 25 05:06:20.211496 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:20.223979 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-a40c9980-0873-45d5-929c-e37e3014f5e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:20.317415 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-a40c9980-0873-45d5-929c-e37e3014f5e9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096988 Aug 25 05:06:20.318013 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Aug 25 05:06:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:22.626934 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-a4e5e241-bfed-4c4b-bb56-067442fd046d admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:22.627939 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-a4e5e241-bfed-4c4b-bb56-067442fd046d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 25 05:06:22.628344 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:22.999007 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-4fa6d5b7-90e2-42ff-a35d-db3b5b340fd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:23.061865 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-4fa6d5b7-90e2-42ff-a35d-db3b5b340fd1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426852 Aug 25 05:06:23.062630 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:23.074427 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-71260357-95ca-4da0-acb0-7efc943ff4f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:23.170566 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-71260357-95ca-4da0-acb0-7efc943ff4f3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099739 Aug 25 05:06:23.171150 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Aug 25 05:06:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:25.524691 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-4fa6d5b7-90e2-42ff-a35d-db3b5b340fd1 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:25.526506 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-4fa6d5b7-90e2-42ff-a35d-db3b5b340fd1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002838 Aug 25 05:06:25.528474 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:25.995471 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-4d5f04b8-3a67-4268-98ec-af4a877d4a66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:26.561211 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-4d5f04b8-3a67-4268-98ec-af4a877d4a66 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.027576 Aug 25 05:06:26.561769 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:26.574408 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-e4aad5ff-a445-41dc-ba27-c774057fc964 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:26.662439 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-e4aad5ff-a445-41dc-ba27-c774057fc964 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092150 Aug 25 05:06:26.663013 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Aug 25 05:06:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:29.043293 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-4d5f04b8-3a67-4268-98ec-af4a877d4a66 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:29.044308 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-4d5f04b8-3a67-4268-98ec-af4a877d4a66 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 25 05:06:29.044913 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:29.502079 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-36b523b6-3892-4d26-8ca0-faebeb0e5731 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "disk": 80}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:29.507577 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:29.582484 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-36b523b6-3892-4d26-8ca0-faebeb0e5731 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.531515 Aug 25 05:06:29.583357 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:29.597001 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-2a06d93a-98f2-4efe-ae39-b322f17ac09a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:29.698401 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-2a06d93a-98f2-4efe-ae39-b322f17ac09a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105373 Aug 25 05:06:29.698980 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Aug 25 05:06:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:32.128885 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-36b523b6-3892-4d26-8ca0-faebeb0e5731 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:32.130565 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-36b523b6-3892-4d26-8ca0-faebeb0e5731 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 Aug 25 05:06:32.131129 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:32.585107 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-a79a72a8-f46d-4900-872e-772a4021bdce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "disk": 160, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:32.661663 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-a79a72a8-f46d-4900-872e-772a4021bdce admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.523887 Aug 25 05:06:32.662230 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Aug 25 05:06:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:32.675073 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-3eb756be-4ea7-4cfe-8dcf-8f3d8576fac3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:32.758863 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-3eb756be-4ea7-4cfe-8dcf-8f3d8576fac3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087355 Aug 25 05:06:32.759693 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Aug 25 05:06:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:06:51.708272 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-a79a72a8-f46d-4900-872e-772a4021bdce admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:51.709311 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-a79a72a8-f46d-4900-872e-772a4021bdce admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 25 05:06:51.709751 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:51.721213 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:52.098915 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-5dadf84d-234a-479f-b017-f4465577a5d5 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:52.116754 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-5dadf84d-234a-479f-b017-f4465577a5d5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400413 Aug 25 05:06:52.117292 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Aug 25 05:06:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:06:53.168708 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-a79a72a8-f46d-4900-872e-772a4021bdce admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:53.169767 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-a79a72a8-f46d-4900-872e-772a4021bdce admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Aug 25 05:06:53.170414 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:53.698931 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-403f6f9b-f862-464e-b92b-973f2bd617a2 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:53.704462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.wsgi [None req-403f6f9b-f862-464e-b92b-973f2bd617a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-403f6f9b-f862-464e-b92b-973f2bd617a2 admin admin] Request method failure captured: Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Accept: application/json Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Accept-Encoding: gzip, deflate Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Connection: keep-alive Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Content-Length: 0 Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Host: 10.222.0.16 Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Openstack-Api-Version: compute 2.90 Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Openstack-System-Scope: None Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: User-Agent: python-novaclient Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Auth-Token: gAAAAABjBwNtmQ1fHuygoOwcSIAmDpr14koOLzzU0HxuHUgKP8mwSuAUT2H3eqX_tsYCheMueUSLQP_hdWVcV-D3rz1IkPA8FNb6lNzqC2lilTh9tHh8f3j4hccyPlvwVyjpCqdGDQKh5yunw7GVUhVPCxS1chtzdvw5SBygpl3TNjHImAY2rsw Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Domain-Id: None Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Domain-Name: None Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Identity-Status: Confirmed Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Is-Admin-Project: True Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Domain-Id: default Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Domain-Name: Default Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Name: admin Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Role: admin,member,reader Aug 25 05:06:53.707727 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Roles: admin,member,reader Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f65e42175ca249f08b4d6dc3b72146f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant: admin Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant-Name: admin Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User: admin Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Domain-Id: default Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Domain-Name: Default Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Id: c2010f49b97347fb8aff29794f27d93f Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Name: admin Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: method: > Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: exception: Flavor 42 could not be found. Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: action_args: {'id': '42'} Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:06:53.709462 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:53.710536 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.711917 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-403f6f9b-f862-464e-b92b-973f2bd617a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:06:53.713182 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-403f6f9b-f862-464e-b92b-973f2bd617a2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392333 Aug 25 05:06:53.713182 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Aug 25 05:06:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:53.718931 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-14a37dd6-4f06-42c4-a986-4d80144109aa admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:53.723073 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:06:53.742442 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-14a37dd6-4f06-42c4-a986-4d80144109aa admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026612 Aug 25 05:06:53.742977 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Aug 25 05:06:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:06:53.752587 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-732d51d4-dfa1-4c2e-b791-ef8104814ce8 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:53.776099 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-732d51d4-dfa1-4c2e-b791-ef8104814ce8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027073 Aug 25 05:06:53.776630 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Aug 25 05:06:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:06:53.786445 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-38b2f191-859c-463e-87c8-e1ec336faef5 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:53.793497 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.wsgi [None req-38b2f191-859c-463e-87c8-e1ec336faef5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-38b2f191-859c-463e-87c8-e1ec336faef5 admin admin] Request method failure captured: Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Accept: application/json Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Accept-Encoding: gzip, deflate Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Connection: keep-alive Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Content-Length: 0 Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Host: 10.222.0.16 Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Openstack-Api-Version: compute 2.90 Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Openstack-System-Scope: None Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: User-Agent: python-novaclient Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Auth-Token: gAAAAABjBwNtmQ1fHuygoOwcSIAmDpr14koOLzzU0HxuHUgKP8mwSuAUT2H3eqX_tsYCheMueUSLQP_hdWVcV-D3rz1IkPA8FNb6lNzqC2lilTh9tHh8f3j4hccyPlvwVyjpCqdGDQKh5yunw7GVUhVPCxS1chtzdvw5SBygpl3TNjHImAY2rsw Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Domain-Id: None Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Domain-Name: None Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Identity-Status: Confirmed Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Is-Admin-Project: True Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Domain-Id: default Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Domain-Name: Default Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Name: admin Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Role: admin,member,reader Aug 25 05:06:53.796856 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Roles: admin,member,reader Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f65e42175ca249f08b4d6dc3b72146f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant: admin Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant-Name: admin Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User: admin Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Domain-Id: default Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Domain-Name: Default Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Id: c2010f49b97347fb8aff29794f27d93f Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Name: admin Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: method: > Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: exception: Flavor 42 could not be found. Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: action_args: {'id': '42'} Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:06:53.809019 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:53.810030 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:53.811335 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-38b2f191-859c-463e-87c8-e1ec336faef5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:06:53.812546 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-38b2f191-859c-463e-87c8-e1ec336faef5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016027 Aug 25 05:06:53.812546 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Aug 25 05:06:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:54.758672 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-732d51d4-dfa1-4c2e-b791-ef8104814ce8 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:54.759683 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-732d51d4-dfa1-4c2e-b791-ef8104814ce8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 25 05:06:54.760074 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:06:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:55.278459 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-f390176c-a0dc-4da5-a639-9a3bb4608314 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:55.283698 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.wsgi [None req-f390176c-a0dc-4da5-a639-9a3bb4608314 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-f390176c-a0dc-4da5-a639-9a3bb4608314 admin admin] Request method failure captured: Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Accept: application/json Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Accept-Encoding: gzip, deflate Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Connection: keep-alive Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Content-Length: 0 Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Host: 10.222.0.16 Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Openstack-Api-Version: compute 2.90 Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Openstack-System-Scope: None Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: User-Agent: python-novaclient Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Auth-Token: gAAAAABjBwNubzis3A6TUIK4Z2um8CvCTj1yL_10LMn7f62IpfSM5xt5AHD1JdmNsuqO-Ba9MaS7gMSGM__hXedIzpiVOSG0i8pRyaXYkQXOWvcucYJ1-TQtd0B5W8U7lvsSUI-lMFe_gI9IN_K8T8TfKKNGsvDB1_7rhoSnWyEM9yYMK6avQD8 Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Domain-Id: None Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Domain-Name: None Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Identity-Status: Confirmed Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Is-Admin-Project: True Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Domain-Id: default Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Domain-Name: Default Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Name: admin Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Role: admin,member,reader Aug 25 05:06:55.285175 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Roles: admin,member,reader Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f65e42175ca249f08b4d6dc3b72146f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant: admin Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant-Name: admin Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User: admin Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Domain-Id: default Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Domain-Name: Default Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Id: c2010f49b97347fb8aff29794f27d93f Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Name: admin Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: method: > Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: exception: Flavor 84 could not be found. Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: action_args: {'id': '84'} Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:06:55.286724 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:55.287573 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-f390176c-a0dc-4da5-a639-9a3bb4608314 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:06:55.290098 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-f390176c-a0dc-4da5-a639-9a3bb4608314 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391590 Aug 25 05:06:55.290098 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Aug 25 05:06:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:55.296331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-a1332d17-ba50-44cf-a2c4-77ea77dc10f7 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:55.311756 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-a1332d17-ba50-44cf-a2c4-77ea77dc10f7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019009 Aug 25 05:06:55.312279 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Aug 25 05:06:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:06:55.322217 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-69528f98-6988-4a61-81f1-7182075ba88e admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:55.337045 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-69528f98-6988-4a61-81f1-7182075ba88e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019029 Aug 25 05:06:55.337571 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Aug 25 05:06:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:06:55.346771 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b5e69967-e5e6-4107-a1f8-162cf2abcba3 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:55.351968 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.wsgi [None req-b5e69967-e5e6-4107-a1f8-162cf2abcba3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b5e69967-e5e6-4107-a1f8-162cf2abcba3 admin admin] Request method failure captured: Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Accept: application/json Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Accept-Encoding: gzip, deflate Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Connection: keep-alive Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Content-Length: 0 Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Host: 10.222.0.16 Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Openstack-Api-Version: compute 2.90 Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Openstack-System-Scope: None Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: User-Agent: python-novaclient Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Auth-Token: gAAAAABjBwNubzis3A6TUIK4Z2um8CvCTj1yL_10LMn7f62IpfSM5xt5AHD1JdmNsuqO-Ba9MaS7gMSGM__hXedIzpiVOSG0i8pRyaXYkQXOWvcucYJ1-TQtd0B5W8U7lvsSUI-lMFe_gI9IN_K8T8TfKKNGsvDB1_7rhoSnWyEM9yYMK6avQD8 Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Domain-Id: None Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Domain-Name: None Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Identity-Status: Confirmed Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Is-Admin-Project: True Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Domain-Id: default Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Domain-Name: Default Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Name: admin Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Role: admin,member,reader Aug 25 05:06:55.353451 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Roles: admin,member,reader Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f65e42175ca249f08b4d6dc3b72146f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant: admin Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant-Name: admin Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User: admin Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Domain-Id: default Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Domain-Name: Default Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Id: c2010f49b97347fb8aff29794f27d93f Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Name: admin Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: method: > Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: exception: Flavor 84 could not be found. Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: action_args: {'id': '84'} Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:06:55.355002 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:55.355830 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:55.356962 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b5e69967-e5e6-4107-a1f8-162cf2abcba3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:06:55.358038 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b5e69967-e5e6-4107-a1f8-162cf2abcba3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011523 Aug 25 05:06:55.358038 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Aug 25 05:06:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:56.319118 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-69528f98-6988-4a61-81f1-7182075ba88e admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:56.320671 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-69528f98-6988-4a61-81f1-7182075ba88e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Aug 25 05:06:56.321059 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:56.843665 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-eca799f0-9167-4ced-b188-3e53a0f6711b admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:56.849275 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.wsgi [None req-eca799f0-9167-4ced-b188-3e53a0f6711b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-eca799f0-9167-4ced-b188-3e53a0f6711b admin admin] Request method failure captured: Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Accept: application/json Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Accept-Encoding: gzip, deflate Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Connection: keep-alive Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Content-Length: 0 Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Host: 10.222.0.16 Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Openstack-Api-Version: compute 2.90 Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Openstack-System-Scope: None Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: User-Agent: python-novaclient Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Auth-Token: gAAAAABjBwNwG19DFjgi0dFOw5FKUZFBcWEaI0hwcJmG3LaPf8h7RAM9nDKKK2QVLDv99n8Tl1fQpQ4gOpI0twNSi8OG96MVEhMkvbO9KDWACRZcXbcqkbrmTZocKKROA8zePmDakly-Qg9-v7DcDsSwJs2HXoXSU_cpeXB-4tTYcPgS3ABDPjI Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Domain-Id: None Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Domain-Name: None Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Identity-Status: Confirmed Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Is-Admin-Project: True Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Domain-Id: default Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Domain-Name: Default Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Project-Name: admin Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Role: admin,member,reader Aug 25 05:06:56.850796 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Roles: admin,member,reader Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f65e42175ca249f08b4d6dc3b72146f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant: admin Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-Tenant-Name: admin Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User: admin Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Domain-Id: default Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Domain-Name: Default Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Id: c2010f49b97347fb8aff29794f27d93f Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: X-User-Name: admin Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: method: > Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: exception: Flavor 451 could not be found. Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: action_args: {'id': '451'} Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:06:56.852331 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:56.853373 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.854762 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-eca799f0-9167-4ced-b188-3e53a0f6711b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:06:56.856063 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-eca799f0-9167-4ced-b188-3e53a0f6711b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388855 Aug 25 05:06:56.856063 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Aug 25 05:06:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:56.861739 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-99bfe6d4-fb5a-487b-a7fc-b29fe1ddc0e7 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:56.877052 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-99bfe6d4-fb5a-487b-a7fc-b29fe1ddc0e7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018888 Aug 25 05:06:56.877566 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Aug 25 05:06:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:06:56.887393 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:56.902094 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018270 Aug 25 05:06:56.902605 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Aug 25 05:06:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:06:56.911403 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-0e17f87e-bc14-4cd8-8077-3d10cba03833 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:56.916656 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.wsgi [None req-0e17f87e-bc14-4cd8-8077-3d10cba03833 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-0e17f87e-bc14-4cd8-8077-3d10cba03833 admin admin] Request method failure captured: Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Accept: application/json Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Accept-Encoding: gzip, deflate Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Connection: keep-alive Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Content-Length: 0 Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Host: 10.222.0.16 Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Openstack-Api-Version: compute 2.90 Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Openstack-System-Scope: None Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: User-Agent: python-novaclient Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Auth-Token: gAAAAABjBwNwG19DFjgi0dFOw5FKUZFBcWEaI0hwcJmG3LaPf8h7RAM9nDKKK2QVLDv99n8Tl1fQpQ4gOpI0twNSi8OG96MVEhMkvbO9KDWACRZcXbcqkbrmTZocKKROA8zePmDakly-Qg9-v7DcDsSwJs2HXoXSU_cpeXB-4tTYcPgS3ABDPjI Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Domain-Id: None Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Domain-Name: None Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Identity-Status: Confirmed Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Is-Admin-Project: True Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Domain-Id: default Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Domain-Name: Default Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Project-Name: admin Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Role: admin,member,reader Aug 25 05:06:56.918176 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Roles: admin,member,reader Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f65e42175ca249f08b4d6dc3b72146f4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f65e42175ca249f08b4d6dc3b72146f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant: admin Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant-Id: f65e42175ca249f08b4d6dc3b72146f4 Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-Tenant-Name: admin Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User: admin Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Domain-Id: default Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Domain-Name: Default Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Id: c2010f49b97347fb8aff29794f27d93f Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: X-User-Name: admin Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: method: > Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: exception: Flavor 451 could not be found. Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: action_args: {'id': '451'} Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:06:56.919693 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:56.920681 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: ERROR nova.api.openstack.wsgi Aug 25 05:06:56.921808 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-0e17f87e-bc14-4cd8-8077-3d10cba03833 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:06:56.922853 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-0e17f87e-bc14-4cd8-8077-3d10cba03833 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011544 Aug 25 05:06:56.922853 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Aug 25 05:06:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 05:06:57.867990 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:57.868991 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 25 05:06:57.869378 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:58.387188 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-3b65c3b6-ef29-4d16-ac78-a1dfaaa9eab7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:06:58.460595 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-3b65c3b6-ef29-4d16-ac78-a1dfaaa9eab7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.453888 Aug 25 05:06:58.461139 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Aug 25 05:06:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:06:59.423475 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:06:59.424516 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 25 05:06:59.424915 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:06:59.947021 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-f2c1733e-f705-4568-aacf-d84a32aa0df9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:07:00.018398 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-f2c1733e-f705-4568-aacf-d84a32aa0df9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.455168 Aug 25 05:07:00.018947 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Aug 25 05:06:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:07:00.971646 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:00.972645 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 25 05:07:00.973037 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:07:01.498101 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-d296a050-c48b-45a8-986a-1db187329667 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:07:01.566674 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-d296a050-c48b-45a8-986a-1db187329667 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.456798 Aug 25 05:07:01.567220 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Aug 25 05:07:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:07:02.527714 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:02.528719 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 25 05:07:02.529109 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:07:03.040502 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-4fc17bd5-beca-4a89-9c0a-cde1f1d5ca81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:07:03.127078 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-4fc17bd5-beca-4a89-9c0a-cde1f1d5ca81 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461132 Aug 25 05:07:03.127633 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Aug 25 05:07:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:07:04.080401 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:04.081398 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 25 05:07:04.081825 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:07:04.598258 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-dd39c4b6-14e5-44cb-a13e-f26dd97ba79a admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:04.619549 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-dd39c4b6-14e5-44cb-a13e-f26dd97ba79a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401283 Aug 25 05:07:04.620276 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu Aug 25 05:07:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:07:57.288818 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:57.289866 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-b0d912bd-d716-4f4d-bd7b-7889468923eb admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 25 05:07:57.290268 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Thu Aug 25 05:07:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:07:57.300590 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:57.678252 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-f318ad4c-2549-4141-becd-931eea82c8cf admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:57.699471 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-f318ad4c-2549-4141-becd-931eea82c8cf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403235 Aug 25 05:07:57.700012 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Aug 25 05:07:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:07:57.721385 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG dbcounter [-] [106272] Writing DB stats nova_api:SELECT=14 {{(pid=106272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:07:57.725133 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-de9e7daf-1a7a-4d57-ae24-1da32abf5264 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:57.732621 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-de9e7daf-1a7a-4d57-ae24-1da32abf5264 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012796 Aug 25 05:07:57.733132 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Aug 25 05:07:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:07:57.745218 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-bdf97e5c-fa1e-4143-aa26-e0fe3caae426 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:57.752750 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-bdf97e5c-fa1e-4143-aa26-e0fe3caae426 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011053 Aug 25 05:07:57.753258 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Aug 25 05:07:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:07:57.765469 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:57.773234 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011647 Aug 25 05:07:57.773786 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Aug 25 05:07:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:07:57.784785 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-db529604-d2dd-4d55-b790-a71e89626a3c admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:07:57.792091 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-db529604-d2dd-4d55-b790-a71e89626a3c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010745 Aug 25 05:07:57.792594 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Aug 25 05:07:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:11:27.112895 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:27.113967 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 25 05:11:27.114362 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:11:27.259451 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_api:SELECT=6 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:11:27.417960 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:27.421419 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:27.421945 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:27.422367 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:27.423064 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:27.423496 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:27.423901 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:27.457902 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-e657afe7-2cd2-4e70-a4c3-49fa56e031f2 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199948 Aug 25 05:11:27.458444 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Aug 25 05:11:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:11:28.284030 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:28.285037 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 25 05:11:28.286085 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:11:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:11:28.476474 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:28.479799 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:28.480270 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:28.480690 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:28.481392 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:28.481937 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:28.482345 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:28.501273 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-2107ffb9-db26-40c9-a251-4b6a499c2966 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076060 Aug 25 05:11:28.501844 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Aug 25 05:11:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:11:39.736654 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:39.737690 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 25 05:11:39.738085 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:11:39.879992 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_cell0:SELECT=4 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:11:39.880718 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_cell1:SELECT=4 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:11:39.881345 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG dbcounter [-] [106273] Writing DB stats nova_api:SELECT=8 {{(pid=106273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:11:39.928877 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:39.933044 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:39.933044 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:39.933244 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:39.933942 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:39.934388 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:39.934805 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:39.961005 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-a8c6a3a0-5b91-418f-9698-2442593718d9 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085837 Aug 25 05:11:39.961562 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Aug 25 05:11:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:11:40.783678 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: DEBUG nova.api.openstack.wsgi [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] Calling method '>' {{(pid=106272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:40.784684 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: INFO nova.api.openstack.requestlog [None req-5406945b-d09d-45ef-8a91-47085de81b90 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 25 05:11:40.785741 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: [pid: 106272|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Aug 25 05:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:11:40.976548 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG nova.api.openstack.wsgi [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] Calling method '>' {{(pid=106273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:11:40.979976 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:40.980474 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:40.980894 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:40.981729 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:11:40.982171 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:11:40.982582 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: DEBUG oslo_concurrency.lockutils [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:11:41.004000 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: INFO nova.api.openstack.requestlog [None req-52d76229-7c96-48a6-a3dd-9b8c7cda2426 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080937 Aug 25 05:11:41.004475 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: [pid: 106273|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Aug 25 05:11:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:12:38.143359 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: Thu Aug 25 05:12:38 2022 - graceful shutdown triggered... Aug 25 05:12:38.143492 dv-cinder-853910-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 25 05:12:38.144309 dv-cinder-853910-2-iscsi devstack@n-api.service[106272]: Gracefully killing worker 1 (pid: 106272)... Aug 25 05:12:38.145615 dv-cinder-853910-2-iscsi devstack@n-api.service[106273]: Gracefully killing worker 2 (pid: 106273)... Aug 25 05:12:39.144505 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: worker 1 buried after 1 seconds Aug 25 05:12:39.145067 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: worker 2 buried after 1 seconds Aug 25 05:12:39.145067 dv-cinder-853910-2-iscsi devstack@n-api.service[106271]: goodbye to uWSGI. Aug 25 05:12:39.146052 dv-cinder-853910-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 25 05:12:39.146618 dv-cinder-853910-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 25 05:12:39.149402 dv-cinder-853910-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 05:12:39.158742 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 05:12:39 2022] *** Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: nodename: dv-cinder-853910-2-iscsi Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: machine: x86_64 Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: clock source: unix Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: pcre jit disabled Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: detected number of CPU cores: 4 Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: current working directory: / Aug 25 05:12:39.160714 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: detected binary path: /usr/bin/uwsgi-core Aug 25 05:12:39.161477 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: your processes number limit is 47680 Aug 25 05:12:39.161477 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: your memory page size is 4096 bytes Aug 25 05:12:39.161477 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: detected max file descriptor number: 2048 Aug 25 05:12:39.161477 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: lock engine: pthread robust mutexes Aug 25 05:12:39.161477 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: thunder lock: enabled Aug 25 05:12:39.161477 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 05:12:39.161477 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 05:12:39.201734 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: Python main interpreter initialized at 0x55ff7edb99c0 Aug 25 05:12:39.201734 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: python threads support enabled Aug 25 05:12:39.201734 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: your server socket listen backlog is limited to 100 connections Aug 25 05:12:39.201734 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: your mercy for graceful operations on workers is 90 seconds Aug 25 05:12:39.202145 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 05:12:39.202225 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: *** Operational MODE: preforking *** Aug 25 05:12:39.202480 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: *** uWSGI is running in multiple interpreter mode *** Aug 25 05:12:39.202480 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: spawned uWSGI master process (pid: 121292) Aug 25 05:12:39.206304 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: spawned uWSGI worker 1 (pid: 121310, cores: 1) Aug 25 05:12:39.206304 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: spawned uWSGI worker 2 (pid: 121314, cores: 1) Aug 25 05:12:39.206304 dv-cinder-853910-2-iscsi devstack@n-api.service[121292]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 05:12:39.202681 dv-cinder-853910-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 05:12:39.865416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 05:12:39.868985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 05:12:41.023947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:12:41.023947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: from cryptography.utils import int_from_bytes Aug 25 05:12:41.024651 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:12:41.024651 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: from cryptography.utils import int_from_bytes Aug 25 05:12:41.026650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:12:41.026650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: from cryptography.utils import int_from_bytes Aug 25 05:12:41.027120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 05:12:41.027120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: from cryptography.utils import int_from_bytes Aug 25 05:12:43.437221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:12:43.437901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:12:43.437997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:12:43.438300 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:12:43.438580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:12:43.438992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.439321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.439749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 05:12:43.440121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.440231 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 05:12:43.440430 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.440538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 05:12:43.440749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.440864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 05:12:43.441077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.441189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 05:12:43.441403 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.441566 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.441769 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.441930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.442039 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.442232 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.442344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.442561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.442680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-2-iscsi {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.442954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.443074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.443264 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.443444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.443597 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.443743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.443905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.444079 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.444235 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.444380 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.444533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.444677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.444832 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.444984 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.445136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-2-iscsi {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.445298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.446883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.447151 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.447382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.447602 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.447825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.448046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.448266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.448496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.448714 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.448936 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.449155 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.449377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.449673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.449921 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.450143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.450378 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.450588 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.450811 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.451205 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.451460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.451685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.451910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-2-iscsi {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.452129 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.452357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.452541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.452727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.452920 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.453092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.453237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.453430 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.453605 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.454071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.454227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.454388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.455097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.455266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.455445 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-2-iscsi {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.455606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.455809 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.456386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.456561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.456719 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.457425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.457609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.457766 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.457913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.458158 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.458330 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.458485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.458923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.459088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.459246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.459400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.459788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.459955 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.460103 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.460255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.460851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.461015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.461183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.461183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.461474 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.461754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.461921 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.462210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.462372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.462526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.462672 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.462833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.462997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.463153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.463320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.463472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.463643 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.463916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.464200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.464321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.465258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.465390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.465520 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.465664 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.471200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.471351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.471469 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.471590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.471733 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.471858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.471979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.472163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.472283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.472408 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.472535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.472658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.472777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.472889 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.473007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.473266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.473386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.473499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.473654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.473774 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.473900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.476409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.476561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.476561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.476788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.476911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.477035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.477162 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.477281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.477394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.477506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.478501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.478631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.478757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.478871 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.478991 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.479110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.479223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.480610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.480747 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.480865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.480985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481341 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.481994 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.482121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.482241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.482623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.482757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.482935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.484955 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.485149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.485348 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.486153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.486324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.486500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.486715 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.486892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.486892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.487200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.487348 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.487501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.487501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.487854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.488045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.488196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.488341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.488493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.488656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.490321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.490491 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.490640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.490844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.491008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.491305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.491476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.491635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.491789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.491942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.492088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.492243 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.492390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.492390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.492665 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.492819 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.492993 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.493140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.493291 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.493446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.493621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.493787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.493947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.494103 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.494249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.494249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.494639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.494639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.494973 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.495163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.495434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.495617 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.495774 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.495920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.496073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.496073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.496357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.496527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.496679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.496824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.496988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.497140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.497304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.497458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.497648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.497648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.497943 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.497943 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.498225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.498379 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.498532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.498729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.498908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.498908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.499769 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.499917 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.500072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.500251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.500609 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.500773 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.500918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.501099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.501253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.501409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.501555 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.501794 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.501990 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.502161 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.502308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.502308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.502604 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.502762 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.502934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.503092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.503256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.503410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.503555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.503700 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.503855 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.504008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.504176 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.504323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.504468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.504640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.504872 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.505030 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.505211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.506714 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.506870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.517242 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.517423 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.517575 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.517805 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.518039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 05:12:43.518200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.518356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.518504 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.518664 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.518811 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.518964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.519117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.519280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.519796 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.519962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.520119 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.520278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.520432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.520589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.520934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.521103 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.521259 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.521413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.521568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.521752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.521913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.522087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.522373 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.522537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.522697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.522873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.523636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.523819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.523968 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.524123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.524277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.524431 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.524586 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.524746 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.524895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.525137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.525310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.525474 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.525674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.525854 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.526005 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.526151 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.526295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.526440 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.526585 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.526741 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.526897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.527053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.527209 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.527375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.527537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.527685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.527839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.527987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.528251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.528404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.531650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.531909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.532083 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.532247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.532911 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.533069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.533303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.533458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.533648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.533817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.533974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.534122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.534278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.534426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.534582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.534737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.534891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.535045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.535298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.535471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.535619 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.535772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.535927 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.536087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.536234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.536381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.536533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.536687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.536833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.536988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.537142 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.537315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.537472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.537756 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.537926 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.538095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.538261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.538492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.538652 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.538798 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.538943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.539098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.539244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.539389 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.539547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.539693 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.539849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.540020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.540167 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.540320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.540474 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.540622 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.540777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.540933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.541099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.541713 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.541867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.542143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.542310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.542458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.542613 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.542769 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.542927 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.543080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.543241 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.543432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.543592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.543747 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.543908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.544065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.544231 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.544386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.544534 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.544680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.544835 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.544995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.545151 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.545330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.545549 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.545748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.545912 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.546078 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.546233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.546398 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.546553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.546700 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.546846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.547005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.547159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.547391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.547545 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.547700 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.547895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.548711 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.548878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.549043 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.549191 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.549345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.549506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.549675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.549878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.550034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.550180 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.550333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.550493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.550663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.551060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.551223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.551887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.552085 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.552355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.552516 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.552671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.552827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.553014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.553220 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.553372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.553570 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.553870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.554128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.554418 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.554656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.554831 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.555029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.555201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.555364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.555717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.555897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.556035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.556158 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.556274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.556473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.556595 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.556725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.556840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.557123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.557244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.557366 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.557564 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.557703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.568506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.568683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.568780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.568895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.568996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569276 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569769 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.569950 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570881 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.570983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571173 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571259 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571779 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.571873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572299 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572761 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572850 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.572935 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573828 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.573921 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574005 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574363 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574447 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574629 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.574919 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575173 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575269 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575521 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575604 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575802 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.575987 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576335 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576418 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.576950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577134 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577219 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577313 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577482 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.577979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578449 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578626 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578812 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.578909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579374 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579560 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.579980 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580078 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580165 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580332 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580605 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580689 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580863 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.580956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.581049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.581142 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.581250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.581342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.583447 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.583562 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.583671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.583767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.583861 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.583951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584055 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584242 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584329 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584412 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.584883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585329 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.585621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.589801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.589899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.589991 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590823 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.590909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591125 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591209 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.591903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592188 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592503 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592503 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.592983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593119 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593716 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.593908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594448 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594551 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594641 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.594740 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595837 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.595929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596109 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596195 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596279 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596363 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596454 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.596990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597192 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597276 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597812 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.597992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598375 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.598820 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.599431 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.599643 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.599764 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.599764 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.599974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.600086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.600086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.600086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.600426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.600547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.600668 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601147 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601263 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601831 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.601972 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.602105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.602244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.602378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.602516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.602667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.602808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.602954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.603094 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.603233 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.603364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.603514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.603646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.603783 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.603914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.604051 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.604189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.604333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.604487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.604611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.604743 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.604874 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.605012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.605153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.605153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.605417 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.605550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.605712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.605865 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.606077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.606219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.606351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.606488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.606621 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.606761 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.606913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.607048 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.607185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.607317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.607455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.607600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.607740 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.607872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608133 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608556 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.608965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.609104 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.609245 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.609377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.609507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.609666 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.609822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.609968 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.610106 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.610245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.610383 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.610567 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.611186 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.611332 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.611471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.611610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.611610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.611865 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.611997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.612141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.612280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.612645 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.612795 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.612945 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.613086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.613296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.613438 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.613571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.613787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.613787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.614228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.614370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.614370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.614370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.614751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.614872 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.614977 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615073 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615625 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615801 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.615909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616081 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616395 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616843 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.616930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617160 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617705 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.617992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618335 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.618965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619142 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.619961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620226 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620418 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620588 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620835 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.620929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.621022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.621150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.621272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.621385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.621506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.621640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.624864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.624997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625095 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625374 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.625988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626373 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626664 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.626919 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627191 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627284 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627876 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.627973 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628336 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628700 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628793 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628886 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.628978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629151 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.629943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630299 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630562 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630685 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.630943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631188 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631274 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631452 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631632 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.631908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632267 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632452 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632560 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632658 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.632985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.633144 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.633367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.633476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.633673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.633952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.634061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.634262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.634358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.634570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.634664 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.634885 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.634986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.635209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.635304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.635585 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.635679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.635937 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.636045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.636245 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.636342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.636664 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.636770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.636979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.637123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.637293 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.637449 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.637638 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.638004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.638212 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.638386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.638722 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.639040 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.639170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.639367 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.639489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.639678 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.639814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.640002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.640126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.640337 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.640467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.640671 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.640801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.640990 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.641118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.641310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.641484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.641716 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.641929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.642059 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.642325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.642559 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.642688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.642817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.643032 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.643157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.643345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.643567 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.643690 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.643927 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.644126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.644288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.644415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.644541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.644666 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.644999 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.645167 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.645372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.645526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.645681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.645841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.646001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.646145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.646314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.646408 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.646632 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.646781 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.646965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.647116 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.647280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.647376 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.647599 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.647707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.647915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.648017 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.648229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.648332 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.648541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.648669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.648851 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.648998 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.649180 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.649311 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.649488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.649659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.649847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.649964 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.650168 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.651960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652226 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652788 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.652887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.653075 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.653183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.653318 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.653455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.653666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.653770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.653866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654464 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654645 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654730 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.654918 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655010 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655103 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655746 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655832 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.655923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656010 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656188 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656478 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656668 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656831 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.656940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.658495 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.658624 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.658727 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.658823 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.658926 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659198 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659290 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659683 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659778 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659866 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.659967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660136 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660313 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660408 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660495 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660579 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.660895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.661064 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.661179 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.661372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.661485 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.661703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.661799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.662025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.662135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.662340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.662451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.662650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.662755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.662963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.663074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.663278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.663390 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.663604 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.663705 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.663904 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.664004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.664211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.664397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.664524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.664626 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.664833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.664925 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.665148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.665251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.665465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.665801 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.665898 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.666117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.666211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.666429 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.666532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.666741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.666835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.667053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.667296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.667394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.667632 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.667787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.667950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.668046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.668255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.668400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.668563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.668657 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.668869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.668971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.669181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.669275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.669496 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.669636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.669836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.669948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.670150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.670255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.670463 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.670568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.670805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.670961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.671117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.671213 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.671443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.671545 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.671780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.671900 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.672100 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.672195 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.672405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.672506 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.672717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.672902 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.673088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.673792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.673946 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.674050 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.674217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.674320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.674546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.674684 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.674839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.674981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.675149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.675260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.675458 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.675749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.675898 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.676055 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.676225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.676379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.676534 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.676683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.676827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.676983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.677135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.677301 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.677453 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.677613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.677772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.677914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.678059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.678201 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.678345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.678518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.678789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.678929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.679105 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.679261 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.679439 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.679585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.679751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.679900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.680070 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.680208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.680383 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.680589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.680736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.680906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.681082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.681226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.681379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.681538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.681754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.681908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.682056 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.682199 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.682356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.682514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.682658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.682814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.682984 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.683136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.683299 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.683457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.683607 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.683793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.684027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.684186 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.684341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.684341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.684622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.684758 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.684916 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.685018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.685223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.685328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.685544 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.685674 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.685910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.686014 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.686227 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.686520 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.686615 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.686846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.686939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.687152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.687300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.687457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.687553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.687769 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.687871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.688079 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.688181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.688386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.688481 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.688715 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.688811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.689023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.689118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.689328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.689423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.689652 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.689767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.689960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.690065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.690261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.690359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.690567 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.690668 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.690873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.690976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.691176 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.691324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.691488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.691645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.691790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.691934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.692097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.692237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.692381 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.692533 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.692680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.692832 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.692977 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.693132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.693273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.693435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.693577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.693740 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.693884 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.694060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.694214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.694369 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.694509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.694654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.694762 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.694897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.695046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.695191 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.695353 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.695497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.695661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.695797 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.695976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.696114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.696262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.696405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.696549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.696692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.696849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.697003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.697146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.697314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.697456 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.697620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.697778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.697933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.698077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.698221 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.698364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.698523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.698672 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.698869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.699017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.699203 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.699355 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.699513 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.699655 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.699838 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.699992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.700168 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.700317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.700471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.700707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.700846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.701049 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.701204 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.701361 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.701510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.701682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.701831 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.701976 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.702126 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.702279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.702425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.702569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.702713 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.702857 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.703001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.703155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.703307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.703460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.703606 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.703750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.703895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.704045 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.704143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.704855 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.704986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.705167 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.705271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.705474 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.705577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.705812 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.705973 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.706121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.706282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.706431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.706578 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.706760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.706906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.707079 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.707246 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.707395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.707559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.707709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.707849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.708003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.708147 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.708299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.708445 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.708588 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.708730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.708883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.709027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.709178 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.709324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.709478 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.709660 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.709810 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.709958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.710110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.710253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.710405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.710559 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.710732 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.710877 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.711045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.711190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.711365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.711500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.711697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.711797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.712006 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.712110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.712310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.712413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.712632 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.712726 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.712939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.713047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.713262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.713413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.713554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.713720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.713908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.714054 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.714247 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.714661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.714841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.715008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.715157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.715303 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.715463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.715631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.715774 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.715931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.716083 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.716229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.716380 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.716479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.716627 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.716730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.716936 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.717045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.717238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.717341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.717540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.717704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.717874 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.717979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.718177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.718272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.718479 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.718574 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.718783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.718967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.719085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.719181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.719391 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.719504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.719692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.719806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.720046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.720197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.720350 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.720454 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.720651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.720747 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.720954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.721055 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.721252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.721345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.721555 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.721673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.721902 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.722009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.722208 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.722309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.722513 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.722608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.722823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.722917 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.723127 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.723235 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.723437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.723531 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.723740 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.723834 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.724044 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.724153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.724347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.724442 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.724653 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.724747 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.724956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.725101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.725283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.725384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.725654 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.725775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.725944 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.726050 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.726258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.726360 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.726568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.726673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.726892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.726996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.727197 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.727293 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.727608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.727728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.727830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.727925 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.728098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.728195 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.728404 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.728500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.728709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.728812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.729031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.729134 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.729342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.729437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.729674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.729771 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.729987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.730093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.730298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.730410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.730608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.730704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.730931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.731036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.731257 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.731362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.731565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.731661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.731873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.731974 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.732191 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.732300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.732497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.732599 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.732803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.732899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.733110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.733214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.733437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.733616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.733776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.733891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.734088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.734184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.734399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.734494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.734708 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.734810 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.735017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.735149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.735331 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.735971 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.736154 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.736262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.736466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.736607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.736781 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.736876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.737095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.737198 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.737421 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.737513 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.737769 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.737916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.738079 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.738237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.738391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.738541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.738706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.738853 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.739053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.739200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.739343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121314) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:12:43.739486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.739696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.740025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.740341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.740654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.740962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 05:12:43.741204 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121310) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 05:12:43.801040 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO dbcounter [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Registered counter for database nova_api Aug 25 05:12:43.802476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO dbcounter [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Registered counter for database nova_api Aug 25 05:12:43.821731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_db.sqlalchemy.engines [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:43.823241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_db.sqlalchemy.engines [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:43.828431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writer thread running {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:43.829825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writer thread running {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:43.883748 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.context [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f327c0d-26cd-440b-94ed-9780c2c19efc(cell1) {{(pid=121314) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:12:43.885518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.context [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2f327c0d-26cd-440b-94ed-9780c2c19efc(cell1) {{(pid=121310) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 05:12:43.888010 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:12:43.888483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:12:43.889538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:12:43.890032 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:12:43.890487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:12:43.891236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:12:43.891598 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:12:43.891726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:12:43.892361 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:12:43.892805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:12:43.893694 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:12:43.894817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:12:43.895679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO dbcounter [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Registered counter for database nova_cell0 Aug 25 05:12:43.896805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO dbcounter [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Registered counter for database nova_cell0 Aug 25 05:12:43.899648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO dbcounter [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Registered counter for database nova_cell1 Aug 25 05:12:43.900801 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO dbcounter [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Registered counter for database nova_cell1 Aug 25 05:12:43.906932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_db.sqlalchemy.engines [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:43.908651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_db.sqlalchemy.engines [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:43.911598 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_db.sqlalchemy.engines [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:43.913816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_db.sqlalchemy.engines [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:43.916267 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writer thread running {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:43.916606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writer thread running {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:43.918434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writer thread running {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:43.924732 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writer thread running {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:44.062831 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO dbcounter [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Registered counter for database nova_cell0 Aug 25 05:12:44.068310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO dbcounter [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Registered counter for database nova_cell0 Aug 25 05:12:44.070139 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_db.sqlalchemy.engines [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121314) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:44.074827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writer thread running {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:44.076725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_db.sqlalchemy.engines [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121310) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 05:12:44.081056 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writer thread running {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 05:12:44.392433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: WARNING keystonemiddleware.auth_token [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:12:44.397210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: WARNING keystonemiddleware.auth_token [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:12:44.399814 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: WARNING keystonemiddleware.auth_token [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:12:44.404431 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: WARNING keystonemiddleware.auth_token [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:12:44.750212 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: WARNING keystonemiddleware.auth_token [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:12:44.756807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: WARNING keystonemiddleware.auth_token [None req-83415d93-5487-4482-96e8-6160c7dbe28d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:12:44.760273 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: WARNING keystonemiddleware.auth_token [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 05:12:44.762252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ff7edb99c0 pid: 121314 (default app) Aug 25 05:12:44.766285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: WARNING keystonemiddleware.auth_token [None req-55c90c30-3f61-41e8-8664-7c1b7f6ea44d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 05:12:44.771648 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ff7edb99c0 pid: 121310 (default app) Aug 25 05:13:20.501426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:20.504582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:20.507155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:20.508102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:21.982427 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-78527f6b-d195-4b15-b9c2-e1963563e90e tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Action: 'create', calling method: .version_select at 0x7f2428ba7a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1439239354", "metadata": {"Type": "work"}}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:23.919033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-78527f6b-d195-4b15-b9c2-e1963563e90e tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.432852 Aug 25 05:13:23.919936 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Aug 25 05:13:20 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 05:13:24.181244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-988d994d-4f13-411c-b4a6-b5cf6d136272 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Calling method '.version_select at 0x7f2428c5c5e0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:24.238903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:24.242495 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:24.247034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:24.249239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:24.838499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-988d994d-4f13-411c-b4a6-b5cf6d136272 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0" status: 200 len: 353 microversion: 2.1 time: 0.903440 Aug 25 05:13:24.841001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:23 2022] GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 => generated 353 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:25.146210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-07e6f2a6-b1cc-46ba-8230-c89d472ef7a4 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a7b8b0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:25.221150 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-07e6f2a6-b1cc-46ba-8230-c89d472ef7a4 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/c3f8b8db-625a-4e6d-96d7-4c553c06709c" status: 200 len: 351 microversion: 2.1 time: 0.079046 Aug 25 05:13:25.222239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:25 2022] GET /compute/v2.1/os-volumes/c3f8b8db-625a-4e6d-96d7-4c553c06709c => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:25.858183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9fe4e5d3-aada-4925-b2c6-283094cd8108 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Calling method '.version_select at 0x7f2428ab1b80>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:25.987490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9fe4e5d3-aada-4925-b2c6-283094cd8108 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0" status: 200 len: 354 microversion: 2.1 time: 0.136523 Aug 25 05:13:25.996497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:25 2022] GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 => generated 354 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:26.000863 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c318560a-a549-427f-9a56-29ee0e5a99cd tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Calling method '.version_select at 0x7f2428a90040>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:26.098156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c318560a-a549-427f-9a56-29ee0e5a99cd tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0" status: 200 len: 354 microversion: 2.1 time: 0.101076 Aug 25 05:13:26.099420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:25 2022] GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:26.116704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-49e2cc60-5a0e-46c3-9a11-68e68092c0c1 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Calling method '.version_select at 0x7f2428a7e040>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:26.389964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-49e2cc60-5a0e-46c3-9a11-68e68092c0c1 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0" status: 202 len: 0 microversion: 2.1 time: 0.275985 Aug 25 05:13:26.392468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 3/6] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:13:26 2022] DELETE /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:13:26.399732 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b1bf8966-d256-4bd5-90db-4bbe5def4710 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Calling method '.version_select at 0x7f2428a90700>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:26.553349 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b1bf8966-d256-4bd5-90db-4bbe5def4710 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0" status: 200 len: 353 microversion: 2.1 time: 0.157837 Aug 25 05:13:26.554371 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:26 2022] GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:27.567401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-149a4f69-e45c-4366-bdb6-9e73fdb42e46 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Calling method '.version_select at 0x7f2428a7e700>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:27.666149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-149a4f69-e45c-4366-bdb6-9e73fdb42e46 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] HTTP exception thrown: Volume 6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 could not be found. Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-149a4f69-e45c-4366-bdb6-9e73fdb42e46 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Request method failure captured: Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 HTTP/1.1 Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwTw9bkOwRUavNb-6e4kE-cQdCRQ567pNSywCuKESxOBq0LEzcGpFyhhaU9_DrnwVvh043VJNDPdILxeYWcJpB0NtGI2isQvgr9Lc5VNW8y5dahlzrk7YsxFM6PasTs9eSex_JGzrELpyIUcgYam6NdUp25b5YacTjx6X07QlBLSUsM Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 4b9739a947184e05b94cfd3b305bd9f5 Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesGetTestJSON-296072274 Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:13:27.670745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b9739a947184e05b94cfd3b305bd9f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4b9739a947184e05b94cfd3b305bd9f5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4b9739a947184e05b94cfd3b305bd9f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4b9739a947184e05b94cfd3b305bd9f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesGetTestJSON-296072274 Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 4b9739a947184e05b94cfd3b305bd9f5 Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesGetTestJSON-296072274 Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesGetTestJSON-296072274-project Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 1f0948bf60d44b8d8c26738d6339b058 Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesGetTestJSON-296072274-project Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Volume 6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 could not be found. Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0'} Aug 25 05:13:27.678737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 could not be found. (HTTP 404) (Request-ID: req-b882ef9a-099c-49d6-88e9-9df59a7bb2c6) Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:13:27.679612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:13:27.680739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 could not be found. Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 05:13:27.681673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 could not be found. Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 could not be found. Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-149a4f69-e45c-4366-bdb6-9e73fdb42e46 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] Returning 404 to user: Volume 6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-149a4f69-e45c-4366-bdb6-9e73fdb42e46 tempest-VolumesGetTestJSON-296072274 tempest-VolumesGetTestJSON-296072274-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0" status: 404 len: 109 microversion: 2.1 time: 0.109922 Aug 25 05:13:27.682565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:27 2022] GET /compute/v2.1/os-volumes/6c58d4bb-9e5e-4a1a-9e48-34b66adf75d0 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:13:28.412963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-748556c7-17a2-45cd-a083-22965c726714 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a7bb80>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:28.906027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-748556c7-17a2-45cd-a083-22965c726714 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/529d28b4-4704-412a-afb5-059d9800fa5f" status: 200 len: 351 microversion: 2.1 time: 0.498976 Aug 25 05:13:28.906595 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:28 2022] GET /compute/v2.1/os-volumes/529d28b4-4704-412a-afb5-059d9800fa5f => generated 351 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:31.111448 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1504074169", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "networks": [{"uuid": "c037f7b3-1ecf-45ca-bbb9-148a361d2c3a"}]}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:31.344620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] validate_networks() for [('c037f7b3-1ecf-45ca-bbb9-148a361d2c3a', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:13:32.770868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cbd527cb-9550-4739-9000-88184e3e1eac tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a909d0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:32.892633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cbd527cb-9550-4739-9000-88184e3e1eac tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8a7ca3b8-008f-452a-bcbc-e1b9888edcb8" status: 200 len: 351 microversion: 2.1 time: 0.127988 Aug 25 05:13:32.893184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 6/10] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:13:32 2022] GET /compute/v2.1/os-volumes/8a7ca3b8-008f-452a-bcbc-e1b9888edcb8 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:13:32.906200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ed4582f6-d4e6-49d1-bd85-14d5858ff778 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a90310>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:33.022907 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:13:33.024149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:13:33.024824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:13:33.025530 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:13:33.026692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:13:33.062227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:33.064640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:33.065711 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:33.069237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:33.069237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:33.069237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:33.092206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ed4582f6-d4e6-49d1-bd85-14d5858ff778 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.190076 Aug 25 05:13:33.093806 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 7/11] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Aug 25 05:13:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:33.109842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-eea94d83-9532-40a5-a49b-1037ae384b5a tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a90dc0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:33.129334 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Getting quotas for project e1f4463eb245468984f4747372d53fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:33.150068 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Getting quotas for user 3107aef7eb954ac4845c8903b005ce93 and project e1f4463eb245468984f4747372d53fc6. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:33.176929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:13:33.182572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:13:33.270318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-eea94d83-9532-40a5-a49b-1037ae384b5a tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.153088 Aug 25 05:13:33.270318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 8/12] 10.222.0.16 () {58 vars in 1149 bytes} [Thu Aug 25 05:13:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:13:33.276374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-44d06ac6-ae2a-4688-a175-35fe6007d126 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a7baf0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:33.398414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d4280682-575e-4f75-9286-00c381e03557 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.797408 Aug 25 05:13:33.401007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 5/13] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:13:33.405351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-44d06ac6-ae2a-4688-a175-35fe6007d126 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.132506 Aug 25 05:13:33.406954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 9/14] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Aug 25 05:13:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:33.418825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-48d0dcf5-ccae-45d9-916f-700ea55ed526 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:33.419431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cc147ea2-49fa-4147-bb7e-5f426e0976eb tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a1dca0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:33.422846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-48d0dcf5-ccae-45d9-916f-700ea55ed526 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:33.670014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cc147ea2-49fa-4147-bb7e-5f426e0976eb tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.254750 Aug 25 05:13:33.681239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 10/15] 10.222.0.16 () {58 vars in 1167 bytes} [Thu Aug 25 05:13:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:33.688432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-832077d2-d2ac-40eb-b6ef-852b0240c17e tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a90a60>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:33.690581 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-48d0dcf5-ccae-45d9-916f-700ea55ed526 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:33.726511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-48d0dcf5-ccae-45d9-916f-700ea55ed526 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1215 microversion: 2.1 time: 0.323860 Aug 25 05:13:33.727532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 6/16] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:33 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1215 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:33.881321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-832077d2-d2ac-40eb-b6ef-852b0240c17e tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.197938 Aug 25 05:13:33.882646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 11/17] 10.222.0.16 () {58 vars in 1170 bytes} [Thu Aug 25 05:13:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:33.898844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-548fbe94-bd69-49c5-84f5-cce09fe0cac5 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f24281195e0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:34.092053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-548fbe94-bd69-49c5-84f5-cce09fe0cac5 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.195331 Aug 25 05:13:34.101996 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 7/18] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Aug 25 05:13:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:34.117974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a0fe24dc-a21e-45dc-afa8-2b3eef40d943 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f2428a1d8b0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:34.268065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a0fe24dc-a21e-45dc-afa8-2b3eef40d943 tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.153267 Aug 25 05:13:34.277856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 12/19] 10.222.0.16 () {58 vars in 1188 bytes} [Thu Aug 25 05:13:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:34.284324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-49a81992-571f-472f-92bc-c751ca874ade tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] Calling method '.version_select at 0x7f24280a8a60>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:34.505751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-49a81992-571f-472f-92bc-c751ca874ade tempest-VolumesTestJSON-719275837 tempest-VolumesTestJSON-719275837-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.225880 Aug 25 05:13:34.507551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 8/20] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Aug 25 05:13:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:34.749856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9e2b5def-4c72-47b0-badf-e2b91f625adc tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:34.750604 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9e2b5def-4c72-47b0-badf-e2b91f625adc tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:35.010318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9e2b5def-4c72-47b0-badf-e2b91f625adc tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:35.060552 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9e2b5def-4c72-47b0-badf-e2b91f625adc tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1215 microversion: 2.1 time: 0.316015 Aug 25 05:13:35.064819 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 13/21] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:34 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1215 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:36.091875 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7d371295-bfa0-48db-8501-f35339ede2d0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:36.093014 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7d371295-bfa0-48db-8501-f35339ede2d0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:36.287231 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7d371295-bfa0-48db-8501-f35339ede2d0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:36.294813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7d371295-bfa0-48db-8501-f35339ede2d0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1215 microversion: 2.1 time: 0.208291 Aug 25 05:13:36.296806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 9/22] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:36 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:36.729457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8f9dc91b-44d1-452f-bb7d-3bdfb2cdad65 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: .version_select at 0x7f2428a7bee0>, body: {"keypair": {"name": "tempest-keypair-1956276812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeKBZbXoo2fLX4YHX8HrbMiDidZ4CIhZT5RMeT83DQfvm3xMVbl1n9vtMCfXO9rzHjbTarPjwW5MTt6ev5QW+1slJSMRRzdFMc6zQoV8szE197jb8M0R7ztr2I1JOgITg=="}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:36.786698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-8f9dc91b-44d1-452f-bb7d-3bdfb2cdad65 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:36.796548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-8f9dc91b-44d1-452f-bb7d-3bdfb2cdad65 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:37.031607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8f9dc91b-44d1-452f-bb7d-3bdfb2cdad65 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.574777 Aug 25 05:13:37.042950 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 14/23] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:13:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:37.320110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:37.321262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:37.337323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:37.345896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:37.347564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:37.356035 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:37.356524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:37.356952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:37.624715 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:37.647281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-05fd51ec-8091-4dab-8ac3-83f82f58e742 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1211 microversion: 2.1 time: 0.333448 Aug 25 05:13:37.647889 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 10/24] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:37 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1211 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:38.669482 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:38.676566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:38.678182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:38.678664 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:38.679093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:38.679785 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:38.680230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:38.680643 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:39.202754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:39.228563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2ca4c0b0-6cf9-4ab5-8ef2-220afc1cf0af tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1267 microversion: 2.1 time: 0.562908 Aug 25 05:13:39.242646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 15/25] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:38 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1267 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:40.255643 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:40.256423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:40.278348 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:40.281984 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:40.284059 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:40.286923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:40.290129 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:40.290604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:40.675860 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:40.691342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a40097fa-0722-439a-9615-cb3299177293 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1273 microversion: 2.1 time: 0.440431 Aug 25 05:13:40.695339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 11/26] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:40 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1273 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:41.219147 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1997165848", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:41.448893 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] validate_networks() for [('0988213e-697f-43c0-8bbc-3d3f281f4405', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:13:41.723422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:41.724194 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:41.737992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:41.738501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:41.738940 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:41.742555 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:41.743047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:41.743489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:42.245868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:42.260699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8f481a61-9ded-4cee-83d1-6861ffd609e6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1273 microversion: 2.1 time: 0.544004 Aug 25 05:13:42.261315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 12/27] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:41 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1273 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:13:43.300777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:43.302271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:43.316338 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:43.353018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:43.353018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:43.353018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:43.353018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:43.353621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:43.353621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:43.663728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:43.688071 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6728884d-08a7-4c41-b2c6-32e8c4b7818e tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1273 microversion: 2.1 time: 0.394891 Aug 25 05:13:43.691312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 13/28] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:43 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:13:44.052864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:13:44.053405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:13:44.053871 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:13:44.054316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:13:44.054804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:13:44.074166 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:44.074955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:44.076725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:44.086759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:44.088124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:44.088827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:44.158190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:44.170122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for user b6ca9962541744bf9d67cc3e05721413 and project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:44.206053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:13:44.209308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:13:44.422491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9d91a1d4-121b-496d-9596-13c2be4096b7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.458230 Aug 25 05:13:44.423261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 16/29] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:13:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 3464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:13:44.459605 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4887973c-c754-4116-b018-c822809da4ac tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:44.460261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4887973c-c754-4116-b018-c822809da4ac tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:44.511988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ce2f3475-8f2b-4c2a-adbf-221b92987c9f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'create', calling method: .version_select at 0x7f2428036ca0>, body: {"keypair": {"name": "tempest-keypair-572337935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqdsP4XdP9TLtpiS9zIDe+RRr5EzbjUCvGc+RpnxyvDduSItLiE4nI7srpwOYrf0RuLYS1JluNc4ORi3n34+jVtXHFF+qqOk6qhI4JTid5zxJDLVJiixmOxRLWuITqKsQ=="}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:44.619714 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-ce2f3475-8f2b-4c2a-adbf-221b92987c9f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:44.647583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-ce2f3475-8f2b-4c2a-adbf-221b92987c9f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for user 3326fcf3ccbc4a978e9e52e25456ad98 and project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:44.876271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ce2f3475-8f2b-4c2a-adbf-221b92987c9f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.899356 Aug 25 05:13:44.877336 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 14/30] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Aug 25 05:13:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 901 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 25 05:13:44.908583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4887973c-c754-4116-b018-c822809da4ac tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:44.918934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4887973c-c754-4116-b018-c822809da4ac tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1222 microversion: 2.1 time: 0.483406 Aug 25 05:13:44.922252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 17/31] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:44 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1222 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:44.930988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:44.940407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:44.961852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:44.961852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:44.961852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:44.962188 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:44.969859 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:44.972572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:45.541551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7070d418-d1e8-4a22-ab4a-09ad0655c2f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'create', calling method: .version_select at 0x7f24281190d0>, body: {"keypair": {"name": "tempest-keypair-194603556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhBbPgCzZPzdiX3UOSgVnF+CdUlkDoXwX3kXxCf6jdxX4d8QUmTNjEbqstYnbd6MkzJ7ccTjJebzUsYu4aZ2zGTKHQDDrv6F+4jma95m0V0375QcmR+56zDVRPQZN6Epw=="}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:45.618766 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-7070d418-d1e8-4a22-ab4a-09ad0655c2f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:45.649453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-7070d418-d1e8-4a22-ab4a-09ad0655c2f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for user d61cf1670a7a43519c7258cd467227b6 and project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:45.737396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:45.752350 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d5b5b387-4a4c-4eba-8914-14fe2a60deb8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.826666 Aug 25 05:13:45.754151 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:44 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:45.786702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7070d418-d1e8-4a22-ab4a-09ad0655c2f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.905196 Aug 25 05:13:45.786702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:13:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:45.792475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-545176865", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:45.941830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] validate_networks() for [('0988213e-697f-43c0-8bbc-3d3f281f4405', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:13:46.791341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:46.792126 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:46.801240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:46.802046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:46.802896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:46.803835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:46.804442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:46.805002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:47.185409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:13:47.190093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:13:47.191181 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:13:47.191759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:13:47.192177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:13:47.210528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:47.212822 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:47.214368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:47.218394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:47.219226 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:47.219826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:47.294945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:47.306237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for user b6ca9962541744bf9d67cc3e05721413 and project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:47.330239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:13:47.333170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:13:47.536736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9e504410-8845-447d-8162-9c53b323a0e3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.777451 Aug 25 05:13:47.548306 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 19/34] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:13:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:13:47.580221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1764902167", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f1da36-d799-4803-8568-258dd71a0604"}], "security_groups": [{"name": "tempest-securitygroup--113505963"}], "key_name": "tempest-keypair-1956276812", "user_data": "}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:47.975292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:47.984515 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dcd36a07-1561-4693-83fa-6446b47cf400 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 1.205281 Aug 25 05:13:48.004288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 16/35] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:46 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:48.017251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c781a158-9938-4cf3-8908-e7bbd7554600 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:48.017900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c781a158-9938-4cf3-8908-e7bbd7554600 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:48.026725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] validate_networks() for [('68f1da36-d799-4803-8568-258dd71a0604', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:13:48.541445 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c781a158-9938-4cf3-8908-e7bbd7554600 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:48.556239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c781a158-9938-4cf3-8908-e7bbd7554600 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1221 microversion: 2.1 time: 0.550773 Aug 25 05:13:48.575065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 17/36] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:48 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1221 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:49.014394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:49.016255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:49.028726 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:49.029225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:49.042378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:49.043538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:49.046018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:49.046660 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:49.602617 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:13:49.603118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:13:49.603579 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:13:49.604062 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:13:49.604481 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:13:49.655317 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:49.655834 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:49.656273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:49.664393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:49.665406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:49.673913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:49.806922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:49.821440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:49.865561 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:13:49.869059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:13:50.078716 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0e63b5ac-5f8a-4780-8107-2af017fbd998 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.529116 Aug 25 05:13:50.080025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 20/37] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:13:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:13:50.113022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:50.113022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:50.135388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:50.136265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:50.139721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:50.140776 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:50.142865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:50.146243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:50.360496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:50.375182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-219cd056-57a2-418d-a05d-c5c5d8d9966e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1273 microversion: 2.1 time: 0.291113 Aug 25 05:13:50.409444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 21/38] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:50 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1273 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:50.435113 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-014872f4-7798-4929-9859-2c8626ac14c7 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:50.439137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-014872f4-7798-4929-9859-2c8626ac14c7 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:50.678123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-014872f4-7798-4929-9859-2c8626ac14c7 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:50.692267 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-014872f4-7798-4929-9859-2c8626ac14c7 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1242 microversion: 2.1 time: 0.280020 Aug 25 05:13:50.693149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 22/39] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:50 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1242 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:50.713466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:50.723714 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-941972f7-cf1f-4c44-a897-f5db87798a62 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 1.713631 Aug 25 05:13:50.730711 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 18/40] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:49 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:51.376551 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-75308313-2e35-4bfa-a8c6-50c6c846cdba req-d91aefb3-0f31-477c-bd7a-d0d6ef51607f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c2d215-3277-4afa-a9af-3cb413c08b66", "tag": "49238283-70cb-4e19-9e70-188976abe7d3"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:51.425202 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:51.426295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:51.443126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-75308313-2e35-4bfa-a8c6-50c6c846cdba req-d91aefb3-0f31-477c-bd7a-d0d6ef51607f service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:51.444394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-75308313-2e35-4bfa-a8c6-50c6c846cdba req-d91aefb3-0f31-477c-bd7a-d0d6ef51607f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:51.446349 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-75308313-2e35-4bfa-a8c6-50c6c846cdba req-d91aefb3-0f31-477c-bd7a-d0d6ef51607f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:51.451285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:51.456305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:51.458458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:51.461621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:51.465072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:51.466087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:51.511476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-75308313-2e35-4bfa-a8c6-50c6c846cdba req-d91aefb3-0f31-477c-bd7a-d0d6ef51607f service nova] Creating event network-changed:49238283-70cb-4e19-9e70-188976abe7d3 for instance 28c2d215-3277-4afa-a9af-3cb413c08b66 on hv-cinder-85391 Aug 25 05:13:51.514107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-75308313-2e35-4bfa-a8c6-50c6c846cdba req-d91aefb3-0f31-477c-bd7a-d0d6ef51607f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 05:13:51.514515 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-75308313-2e35-4bfa-a8c6-50c6c846cdba req-d91aefb3-0f31-477c-bd7a-d0d6ef51607f service nova] Acquired lock "compute-rpcapi-router" {{(pid=121314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 05:13:51.515609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:51.516082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:51.516531 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:51.517233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:51.517712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:51.518137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:51.551496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.compute.rpcapi [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 05:13:51.557058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] Releasing lock "compute-rpcapi-router" {{(pid=121314) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 05:13:51.588931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4f6874dd-b7e2-4bc7-872b-dc8d803c531d None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.892930 Aug 25 05:13:51.598942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 23/41] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:51.722233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e7de9c06-f1e6-48c6-9f1c-06f19d70375f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:51.722942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e7de9c06-f1e6-48c6-9f1c-06f19d70375f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:51.869870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:51.893762 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-33be8d2c-4678-41d5-8294-e2ac618e1a03 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1281 microversion: 2.1 time: 0.478024 Aug 25 05:13:51.913319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 19/42] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:51 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1281 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:13:51.918174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:51.930348 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:51.941242 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:51.942419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:51.945693 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:51.946620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:51.947215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:51.947795 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:52.262813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e7de9c06-f1e6-48c6-9f1c-06f19d70375f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:52.283725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e7de9c06-f1e6-48c6-9f1c-06f19d70375f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1242 microversion: 2.1 time: 0.566437 Aug 25 05:13:52.285209 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:51 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1242 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:52.917745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:52.919098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:52.965891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:52.965891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:52.965891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:52.965891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:52.967648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:52.968353 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:53.203518 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:53.224187 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-be19a162-c310-43ab-9941-7c59f39bc21d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1279 microversion: 2.1 time: 0.307420 Aug 25 05:13:53.229296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 25/44] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:52 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1279 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:53.308899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:53.309666 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:53.320797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:53.323799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:53.325791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:53.330540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:53.330540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:53.335183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:53.633488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:53.655995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-671759cb-a7ef-419e-8d2a-6aa51b886f70 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 1.739320 Aug 25 05:13:53.656996 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 20/45] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:51 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:53.719460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:53.738287 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3355afbf-20f1-472f-a4b8-63e69020cf81 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1294 microversion: 2.1 time: 0.431466 Aug 25 05:13:53.739329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 26/46] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:53 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1294 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:13:54.252394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:54.259746 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:54.269264 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:54.273873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:54.274331 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:54.275072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:54.275549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:54.287079 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:54.680183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:54.680958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:54.699748 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:54.700374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:54.700830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:54.702237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:54.702700 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:54.703427 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:54.812532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:54.825155 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-46e8576e-b390-4ad3-b4cf-a59d9c0db614 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1279 microversion: 2.1 time: 0.576674 Aug 25 05:13:54.828473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 21/47] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:54 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1279 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:54.849254 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:54.854681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:54.868039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:54.871837 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:54.872471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:54.873944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:54.874580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:54.880909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:55.166786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:55.198302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8fce487b-9996-42f7-baef-9ddf9768e70f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1312 microversion: 2.1 time: 0.354602 Aug 25 05:13:55.198917 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:54 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:55.663838 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:55.672969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-db537568-6aff-49e7-a840-05821cff0ce8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.996433 Aug 25 05:13:55.686377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 27/49] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:54 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:55.851148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:55.858347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:55.864451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:55.865241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:55.865925 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:55.866861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:55.867532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:55.868156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:55.872650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=63 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:56.129666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:56.147911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b11b63e7-8133-4e52-84f4-fdd22f0b8cdb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1279 microversion: 2.1 time: 0.303599 Aug 25 05:13:56.150025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 23/50] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:55 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:13:56.225789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:56.226737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:56.246951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:56.248200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:56.249137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:56.255909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:56.256605 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:56.257168 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:56.281334 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1634762268", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28953a19-c976-4328-9ac9-ee52893446db"}], "security_groups": [{"name": "tempest-securitygroup--1921194586"}], "key_name": "tempest-keypair-194603556", "user_data": "}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:56.298306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=5 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:57.090061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:57.110444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a975aa79-adfc-4d3d-b080-60db71bbd49c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1300 microversion: 2.1 time: 0.890491 Aug 25 05:13:57.117090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 28/51] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:56 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1300 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:57.148961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1662972343", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2acaae5e-ff29-4076-80e0-d2cd629fe935"}], "security_groups": [{"name": "tempest-securitygroup--545867735"}], "key_name": "tempest-keypair-572337935", "user_data": "}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:57.434082 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] validate_networks() for [('28953a19-c976-4328-9ac9-ee52893446db', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:13:57.632603 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] validate_networks() for [('2acaae5e-ff29-4076-80e0-d2cd629fe935', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:13:58.547041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=20 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:58.742663 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:13:58.743839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:13:58.744542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:13:58.744941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:13:58.745460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:13:58.764948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:13:58.785191 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:58.785723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:58.786160 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:58.787059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:58.787517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:58.787938 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:58.809004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:58.814361 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for user 3326fcf3ccbc4a978e9e52e25456ad98 and project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:58.834115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:13:58.837024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:13:58.921967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:13:58.922597 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:13:58.923071 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:13:58.923604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:13:58.924145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:13:58.933377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:58.934063 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:58.934492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:58.935484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:58.935939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:58.936354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:58.959553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:13:58.963317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for user d61cf1670a7a43519c7258cd467227b6 and project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:13:58.974604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:13:58.976953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:13:59.164021 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1d47f6f5-0bb2-4038-9336-660244ac3bc7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.887573 Aug 25 05:13:59.172621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 24/52] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:13:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:13:59.178582 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:59.179883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:59.203969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:59.204459 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:59.204885 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:59.205584 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:59.206052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:59.206464 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:59.243590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-dc270234-e5fe-4e59-ae3d-45074df1d718 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.123396 Aug 25 05:13:59.247432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 29/53] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Aug 25 05:13:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 05:13:59.261573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:59.262251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:59.275575 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:59.279766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:59.279766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:59.279766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:59.279766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:59.280459 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:59.510350 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:59.525450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9c6d73db-5cc3-4bd5-97de-90b662467913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.274058 Aug 25 05:13:59.525450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 30/54] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:59 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:59.613094 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:59.627678 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c6df0ad7-5d79-40b8-a7b3-81bcd8d12abe tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.453816 Aug 25 05:13:59.629286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 25/55] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:59 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:59.649678 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:59.650928 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:59.660449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:59.661123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:59.661782 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:59.662647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:59.663791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:59.664685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:59.740485 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-b91a0632-246a-44c8-8586-8bd20d8ef482 req-1ce93cc5-df85-4f6f-bd36-fb2870e48ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3a8721-5c5c-411a-85f9-8ee33510ccb6", "tag": "89194eae-54f6-4cb6-81a1-0443f90b1835"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:13:59.759566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b91a0632-246a-44c8-8586-8bd20d8ef482 req-1ce93cc5-df85-4f6f-bd36-fb2870e48ed2 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:13:59.761865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b91a0632-246a-44c8-8586-8bd20d8ef482 req-1ce93cc5-df85-4f6f-bd36-fb2870e48ed2 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:13:59.767148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b91a0632-246a-44c8-8586-8bd20d8ef482 req-1ce93cc5-df85-4f6f-bd36-fb2870e48ed2 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:13:59.777489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-b91a0632-246a-44c8-8586-8bd20d8ef482 req-1ce93cc5-df85-4f6f-bd36-fb2870e48ed2 service nova] Creating event network-changed:89194eae-54f6-4cb6-81a1-0443f90b1835 for instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 on hv-cinder-85391 Aug 25 05:13:59.784801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-b91a0632-246a-44c8-8586-8bd20d8ef482 req-1ce93cc5-df85-4f6f-bd36-fb2870e48ed2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261543 Aug 25 05:13:59.797717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 31/56] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:13:59.799829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-35fcefb8-7b02-48f4-84c5-ddc8f5d22744 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:59.800883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-35fcefb8-7b02-48f4-84c5-ddc8f5d22744 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:59.848195 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:59.859432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-674c06bb-e282-4891-80b8-f881721c06de tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.228541 Aug 25 05:13:59.864607 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 26/57] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:59 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:59.875847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-35fcefb8-7b02-48f4-84c5-ddc8f5d22744 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:59.880450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b7bab53b-9617-46c8-816f-766b0bdeab25 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:13:59.881179 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b7bab53b-9617-46c8-816f-766b0bdeab25 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:13:59.884842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-35fcefb8-7b02-48f4-84c5-ddc8f5d22744 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1237 microversion: 2.1 time: 0.091245 Aug 25 05:13:59.892729 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 32/58] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:13:59 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:13:59.950861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b7bab53b-9617-46c8-816f-766b0bdeab25 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:59.958238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b7bab53b-9617-46c8-816f-766b0bdeab25 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:59.959749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b7bab53b-9617-46c8-816f-766b0bdeab25 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:13:59.960833 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b7bab53b-9617-46c8-816f-766b0bdeab25 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1281 microversion: 2.20 time: 0.095047 Aug 25 05:13:59.973611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 27/59] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:13:59 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:00.540954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:00.541844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:00.557673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:00.561142 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:00.561731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:00.562608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:00.564437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:00.565876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:00.651294 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:00.653121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:00.659418 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:00.660105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:00.660679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:00.661371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:00.661841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:00.662280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:00.748830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:00.765284 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ad30b5bf-2c0a-4017-9257-4c61347a087c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.228746 Aug 25 05:14:00.766954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 33/60] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:00 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:00.883899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:00.884523 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:00.899651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:00.900481 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:00.901275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:00.902435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:00.903153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:00.904178 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.022828 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:01.032709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d5ffd251-7adb-4408-8f59-3aac04d9f637 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.387765 Aug 25 05:14:01.034178 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 28/61] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:00 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:01.039109 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:01.039940 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:01.056297 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:01.057174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:01.057776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.058748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:01.059471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:01.060667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.098661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:01.107558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e20da86d-3fb7-49ee-aecf-4ec617dfc72f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.228304 Aug 25 05:14:01.115996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 34/62] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:00 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:01.121089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-69002eb6-da36-4f25-b673-90185e3fccb4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:01.121795 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-69002eb6-da36-4f25-b673-90185e3fccb4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:01.135002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:01.143810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c781c294-b088-4fff-9c9f-dc45b0ddd23b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.108454 Aug 25 05:14:01.145955 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 29/63] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:01 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:01.195941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-69002eb6-da36-4f25-b673-90185e3fccb4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:01.205835 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-69002eb6-da36-4f25-b673-90185e3fccb4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:01.207844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-69002eb6-da36-4f25-b673-90185e3fccb4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:01.209036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-69002eb6-da36-4f25-b673-90185e3fccb4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1281 microversion: 2.20 time: 0.091800 Aug 25 05:14:01.209934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 35/64] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:01 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:01.708480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-4754b5d1-9667-4b27-8a5f-ee44a6931e58 req-85a14a6c-e303-413a-b962-7466d5e7d958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00679982-187d-430a-908f-29644650feb4", "tag": "f5a8bbe4-e926-4999-b1e8-599f495bd711"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:01.722462 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4754b5d1-9667-4b27-8a5f-ee44a6931e58 req-85a14a6c-e303-413a-b962-7466d5e7d958 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:01.722931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4754b5d1-9667-4b27-8a5f-ee44a6931e58 req-85a14a6c-e303-413a-b962-7466d5e7d958 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:01.723346 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4754b5d1-9667-4b27-8a5f-ee44a6931e58 req-85a14a6c-e303-413a-b962-7466d5e7d958 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.746627 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-4754b5d1-9667-4b27-8a5f-ee44a6931e58 req-85a14a6c-e303-413a-b962-7466d5e7d958 service nova] Creating event network-changed:f5a8bbe4-e926-4999-b1e8-599f495bd711 for instance 00679982-187d-430a-908f-29644650feb4 on hv-cinder-85391 Aug 25 05:14:01.747394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4754b5d1-9667-4b27-8a5f-ee44a6931e58 req-85a14a6c-e303-413a-b962-7466d5e7d958 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121310) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 05:14:01.748012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4754b5d1-9667-4b27-8a5f-ee44a6931e58 req-85a14a6c-e303-413a-b962-7466d5e7d958 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121310) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 05:14:01.749338 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:01.749952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:01.750550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.751432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:01.756980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:01.756980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.763934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.compute.rpcapi [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 05:14:01.764815 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] Releasing lock "compute-rpcapi-router" {{(pid=121310) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 05:14:01.783814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2f5fa988-2611-4165-8de2-8884b5a61d19 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078722 Aug 25 05:14:01.789882 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:01.790492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:01.793397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 30/65] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:01.797292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:01.797982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:01.798603 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.800233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:01.800851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:01.801407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:01.942438 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:01.950118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-10ff28ee-9963-4d7a-a7a7-88123c2e871c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.164063 Aug 25 05:14:01.950706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 36/66] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:01 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:02.054722 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:02.058896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:02.061725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.062289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.062696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.063375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.063814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.064222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.128791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:02.129489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:02.135751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.136235 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.136646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.137344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.137826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.138234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.203416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:02.212025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3721631a-1976-40aa-bd61-054375914c97 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.161549 Aug 25 05:14:02.213085 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 31/67] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:02 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:02.219103 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:02.219704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:02.226111 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.226808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.227227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.227937 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.228507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.228925 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.290455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:02.298515 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a8a5cce3-4c3d-498f-9027-5af98c04c831 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.174013 Aug 25 05:14:02.299440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 37/68] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:02 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:02.303634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:02.304263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:02.309770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:02.317956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.320708 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4cada4b1-af51-46ec-8379-321b249d3550 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.104228 Aug 25 05:14:02.320920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.320920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.321257 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 32/69] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:02 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:02.321328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.321328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.321328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.383358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:02.392250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:02.393776 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:02.394879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b924aafc-9ff7-441a-9b2f-740ec848b6e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.094733 Aug 25 05:14:02.395420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 38/70] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:02 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:02.971265 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:02.971895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:02.978099 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.978597 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.979574 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:02.979710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:02.980120 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:02.980531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.108220 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:03.115709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e45ee011-01e5-40e3-bf06-4f7fa569e1fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.148661 Aug 25 05:14:03.116533 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 33/71] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:02 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:03.234743 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:03.235571 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:03.241844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.242400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.242999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.244346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.244801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.245227 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.250158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=93 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:03.320263 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:03.320867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:03.327009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.327499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.328104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.328789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.329236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.329682 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.413534 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:03.421635 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2ef22796-06f2-43bd-8c39-5acffc9dba75 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.191488 Aug 25 05:14:03.422831 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 39/72] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:03 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:03.439198 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:03.439802 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:03.445757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.446217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.446636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.447314 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.455658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.455658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.464865 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:03.472692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0f0ed5ad-3359-44a6-816f-7eca9334b088 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.156350 Aug 25 05:14:03.473358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 34/73] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:03 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:03.478077 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:03.478750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:03.488354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.488841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.489307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.492370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.492637 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.493076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.534286 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:03.552424 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0d4b625a-ab1d-4ced-88fc-2849c22f625d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.112499 Aug 25 05:14:03.553512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 40/74] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:03 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:03.575458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:03.585712 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:03.587415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:03.588493 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d7f6618d-7cd8-4d0c-bb53-cd9ac282ff7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.113962 Aug 25 05:14:03.591930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 35/75] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:03 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:03.806702 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-a3e3715a-6012-4f05-a688-23127de836f7 req-4a2e9fe1-195d-405f-bb82-996f4ae2f7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a769edb-35d4-41ea-866f-3eb74f13e938", "tag": "998258dc-63e3-42e3-b67d-ae2e1b94e7e8"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:03.819788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a3e3715a-6012-4f05-a688-23127de836f7 req-4a2e9fe1-195d-405f-bb82-996f4ae2f7ea service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:03.820322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a3e3715a-6012-4f05-a688-23127de836f7 req-4a2e9fe1-195d-405f-bb82-996f4ae2f7ea service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:03.820744 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a3e3715a-6012-4f05-a688-23127de836f7 req-4a2e9fe1-195d-405f-bb82-996f4ae2f7ea service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:03.832853 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-a3e3715a-6012-4f05-a688-23127de836f7 req-4a2e9fe1-195d-405f-bb82-996f4ae2f7ea service nova] Creating event network-changed:998258dc-63e3-42e3-b67d-ae2e1b94e7e8 for instance 6a769edb-35d4-41ea-866f-3eb74f13e938 on hv-cinder-85391 Aug 25 05:14:03.837898 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-a3e3715a-6012-4f05-a688-23127de836f7 req-4a2e9fe1-195d-405f-bb82-996f4ae2f7ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035203 Aug 25 05:14:03.838463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 41/76] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:04.156748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:04.156748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:04.156748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.156748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.157532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.157532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.157532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.157532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.289240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:04.297377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2cc5effc-3f31-4e62-a8ce-efd7d160dbad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.164522 Aug 25 05:14:04.298067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 36/77] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:04 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:04.443288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:04.443984 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:04.450060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.451201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.451632 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.452309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.452755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.453170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.493340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:04.538861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:04.538861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.538861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.538861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.539703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.539703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.539703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.593775 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:04.601374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-de7c5fe4-4d22-41d3-ab0f-e499fe487444 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.162597 Aug 25 05:14:04.601977 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 42/78] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:04 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:04.606741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:04.607483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:04.613630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.614525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.615195 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.616122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.616636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.617273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.647557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:04.655307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ea7a58f3-4944-494f-a558-5e72dfa366ee tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.165694 Aug 25 05:14:04.655870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 37/79] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:04 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:04.666204 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:04.667071 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:04.673909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.674460 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.674952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.675707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:04.676238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:04.676728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:04.682444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:04.691233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f3af7995-e452-4292-a52c-3669f6fd38b4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.088246 Aug 25 05:14:04.691816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 43/80] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:04 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:04.742912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:04.751724 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:04.753219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:04.754341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-676e3489-fa72-43e1-8316-28264bcda847 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.097410 Aug 25 05:14:04.754896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 38/81] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:04 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:05.318564 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:05.319160 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:05.325132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.325622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.326058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.326749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.327217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.327628 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.460908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:05.471076 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f293340a-dade-48b0-9457-a4309380746c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.156373 Aug 25 05:14:05.471878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 44/82] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:05 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:05.622902 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:05.623504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:05.629450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.629963 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.630554 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.631238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.631745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.632183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.675892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:05.677871 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:05.682731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.683213 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.683732 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.684414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.684852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.685265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.774740 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:05.784111 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8a2d80ba-9ce5-4ff6-be14-8c60f321e7db tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.165253 Aug 25 05:14:05.784922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 39/83] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:05 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:05.789741 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:05.790351 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:05.796260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.796743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.797267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.798141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.798748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.799316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.841945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:05.851782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-02b1f2dc-0052-4cdb-a1b5-1e4d1b31511d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.179840 Aug 25 05:14:05.852443 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 45/84] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:05 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:05.864849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:05.868712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:05.869288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:05.873887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7a2a2717-b355-4953-996a-d5206746dcd8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.087893 Aug 25 05:14:05.874692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:05 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:05.879232 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.879784 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.880305 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.881080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:05.881640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:05.882128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:05.944040 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:05.952623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:05.954250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:05.955348 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c9e112e4-d40b-4be6-bcc4-0d65d5c66a3e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.094275 Aug 25 05:14:05.955912 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 46/86] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:05 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:06.492258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:06.492871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:06.499012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.499483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.499950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:06.500616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.501054 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.501469 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:06.655364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:06.659209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:06.663826 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a27febe8-838a-45b9-b38f-016faac0d291 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.175698 Aug 25 05:14:06.664528 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 41/87] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:06 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:06.804411 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:06.805022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:06.811672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.812223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.812648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:06.813323 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.813807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.814287 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:06.872982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:06.873748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:06.879684 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.880160 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.880608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:06.881292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.882051 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.882468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:06.946200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:06.954517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0830c333-6ba8-4b2b-a5d0-ee1d6bbd288c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.154039 Aug 25 05:14:06.955102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 47/88] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:06 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:06.961492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:06.961492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:06.968445 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.968928 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.969355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:06.970080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:06.970514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:06.970929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:07.021200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:07.029385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4be9a90e-0564-4117-b03d-ad26f16f832e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.160185 Aug 25 05:14:07.030098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 42/89] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:06 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:07.033644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:07.034845 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:07.035443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:07.042521 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:07.042813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8092a5ca-9f36-40c1-910b-da6e6b7e2c18 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.086090 Aug 25 05:14:07.043199 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:07.043428 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 48/90] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:06 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:07.043626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:07.044312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:07.044753 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:07.045162 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:07.104519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:07.112942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:07.114534 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:07.115616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f7a8e3d6-be9a-4409-b2b6-9ae7c4188bd6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.084614 Aug 25 05:14:07.116166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 43/91] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:07 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:07.684235 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:07.685496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:07.691404 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:07.691876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:07.692302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:07.692987 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:07.693432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:07.693869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:07.821755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:07.829275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d94effd3-6b49-4edf-b3db-a873d3e9f797 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.148887 Aug 25 05:14:07.829897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 49/92] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:07 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:07.977770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:07.978371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:07.984656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:07.985125 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:07.985546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:07.986247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:07.986691 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:07.987101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.049618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:08.050222 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:08.056535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.057014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.057444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.058181 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.058631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.059349 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.198988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:08.206976 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bec2e852-80c4-4d0c-be65-2810f741261e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.161221 Aug 25 05:14:08.207565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 50/93] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:08 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:08.212139 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:08.212743 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:08.220333 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.221088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.221671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.222490 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.223012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.223435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.289970 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:08.300530 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-56270c2b-032f-4c60-ab04-af84fd7b29bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.090059 Aug 25 05:14:08.300530 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 51/94] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:08 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:08.304241 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:08.304847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:08.307847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:08.311014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.311944 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.311944 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.312597 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.313041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.313456 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.317113 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3024e525-86ca-4d82-a777-e9753c0fc35d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.343191 Aug 25 05:14:08.318067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 44/95] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:07 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:08.375401 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:08.383576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:08.385077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:08.386257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1ba06e6d-3e0b-409b-8660-4e01de4daa63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.085877 Aug 25 05:14:08.386809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 52/96] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:08 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:08.849993 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:08.850629 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:08.858584 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.859061 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.859489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.860169 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:08.860602 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:08.861360 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:08.992542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:09.001007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-308ea716-c9c6-40b6-b75c-577c85207b42 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.155025 Aug 25 05:14:09.001672 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 45/97] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:08 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:09.229719 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:09.230379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:09.232786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=10 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:09.239969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.239969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.239969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.239969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.240294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.240469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.325810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:09.326413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:09.339146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.339806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.345653 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.345653 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.345653 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.345653 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.381390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:09.389136 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2a0333c8-8b81-4608-8995-f72fc8a7767b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.163248 Aug 25 05:14:09.389734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 53/98] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:09 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:09.397734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:09.398352 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:09.405102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.405741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.406177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.406922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.407296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.407791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.425694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:09.433812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-645278a2-2ae1-4141-baa9-54c75ab55b1b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.111736 Aug 25 05:14:09.434478 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 46/99] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:09 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:09.439420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:09.440223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:09.446378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.446864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.447286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.454630 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:09.454630 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:09.454630 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:09.523301 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:09.530111 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:09.531663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:09.532753 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-54042d78-908c-4167-8b0c-97cce99a3414 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.097306 Aug 25 05:14:09.533345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 47/100] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:09 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:09.542210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:09.552475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1426a4ba-ad6e-47d5-af62-43794eb9c1e7 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.159341 Aug 25 05:14:09.552475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 54/101] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:09 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:10.021493 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:10.032886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:10.032886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=8 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:10.032886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.032886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.033217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.033217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.033217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.033217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.155107 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:10.163207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ff8edb34-b0b2-4baf-83ab-8bf6b19d98d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.145636 Aug 25 05:14:10.163768 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 48/102] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:10 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:10.414818 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:10.415318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:10.421731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.422214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.422640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.423325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.423804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.424221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.455215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:10.456426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:10.463041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.463578 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.464305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.465088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.465613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.466039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.532611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:10.540317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-233541d6-b666-4d29-beb2-c412b1d29049 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.089859 Aug 25 05:14:10.540890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 49/103] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:10 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:10.555345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:10.556048 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:10.556519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:10.562532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.563014 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.563441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.564123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.564564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.564980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.565500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-11db8275-2856-4921-b5c6-4d2c0d85ea0c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.154604 Aug 25 05:14:10.566181 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 55/104] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:10 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:10.571497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:10.572248 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:10.579230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.581325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.581831 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.582548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:10.583016 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:10.583438 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:10.598809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=100 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:10.637733 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:10.643571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:10.645076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:10.646201 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4e18d2dd-55fc-42b0-9e51-c630758b48ff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.094571 Aug 25 05:14:10.646757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 50/105] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:10 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:14:10.720263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:10.727771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8ebcb4ea-499e-4bff-bfd0-09949045b439 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.159813 Aug 25 05:14:10.729335 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 56/106] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:10 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:11.183589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:11.184217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:11.190806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.191281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.191708 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.192390 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.192835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.193251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.319274 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:11.327543 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c281beff-46fc-41de-9fdc-0478a28bf736 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.147781 Aug 25 05:14:11.328107 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 51/107] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:11 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:11.562767 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:11.563374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:11.565170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=40 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:11.570016 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.570489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.570919 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.571609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.572058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.572705 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.590098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:11.590736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:11.598711 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.599522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.600128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.601029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.601852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.602400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.654954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:11.662808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-96e4461e-ec38-4928-a532-91439b92d875 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.106027 Aug 25 05:14:11.667130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 57/108] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:11 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:11.668263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:11.669410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:11.675298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.675773 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.676198 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.676883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.677325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.677786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.739719 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:11.746633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:11.748703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:11.749816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a73499f5-ce6c-4b47-a537-c3ef1037d0d5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.085222 Aug 25 05:14:11.750362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 58/109] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:11 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:11.758657 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:11.761034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:11.761180 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=4 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:11.761913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:11.768958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.769506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.769964 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.770648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:11.771091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:11.771327 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-705b67a8-81d6-4022-adfa-0aa25541846b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.187471 Aug 25 05:14:11.771500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:11.776089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 52/110] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:11 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:11.906092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:11.913672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0b0e0e85-db90-4617-a686-3600dd2714b9 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.156677 Aug 25 05:14:11.914238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 59/111] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:11 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:12.348728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:12.349384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:12.355336 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.355965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.356324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.357000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.357445 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.357890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.489506 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:12.497840 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-93c0ab28-f863-4ea3-b5be-23d8a69f44d0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.153358 Aug 25 05:14:12.498522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 53/112] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:12 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:12.683626 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:12.684228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:12.691759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.692441 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.692892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.693638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.694106 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.694548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.757453 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:12.765796 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f046f9b3-689c-4d1d-ae4e-8164323c9c65 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.086313 Aug 25 05:14:12.766892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 60/113] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:12 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:12.783951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:12.784781 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:12.790884 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.791549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.792157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.793001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.793437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.794061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:12.794394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.794816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:12.805746 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.806231 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.806659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.807338 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.807777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.808223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.861854 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:12.870580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:12.872604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:12.873749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-621b262e-4c6b-4350-ab43-44b2662e81b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.093603 Aug 25 05:14:12.880323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 54/114] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:12 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:12.936187 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:12.936892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:12.943993 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.951921 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.960601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.960601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:12.960601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:12.960601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:12.996409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:13.004854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-12ec88c4-1850-4f72-b941-0c01ade31e36 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.216275 Aug 25 05:14:13.005560 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 61/115] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:12 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:13.095277 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:13.102945 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ec0f3f9c-4cf2-4125-adf0-dff2962cdd64 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.171737 Aug 25 05:14:13.103524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 55/116] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:12 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:13.519265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:13.519819 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:13.527156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:13.527156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:13.527156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:13.527409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:13.527812 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:13.528208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:13.668002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:13.676477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fd239d5d-b091-4428-aa3b-639ca3b6bc3e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.161553 Aug 25 05:14:13.677124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 62/117] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:13 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:13.786656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:13.787192 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:13.793218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:13.794225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:13.794645 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:13.795354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:13.795784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:13.796192 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:13.859425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:13.867062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9642a20d-b8cd-42ee-bb12-17737b584dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.084356 Aug 25 05:14:13.867626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 56/118] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:13 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:13.899285 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:13.899883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:13.905958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:13.906426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:13.906848 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:13.907519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:13.907966 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:13.908376 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:13.969399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:13.978126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:13.983310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:13.983310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6af43549-c939-4ecf-a270-2d7efd6c0989 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.085443 Aug 25 05:14:13.983310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 63/119] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:13 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:14.032576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:14.045148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:14.045148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.045148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.045148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.045842 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.045842 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.045842 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.123766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:14.124367 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:14.130563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.131102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.131527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.132214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.132667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.133084 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.181636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:14.189705 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-80fb431e-3154-4ac1-bc31-b2c4946d4074 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.166829 Aug 25 05:14:14.190296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 57/120] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:14 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:14.263303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:14.274397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-16e26fb3-f856-4317-bde9-da773696c816 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.154081 Aug 25 05:14:14.274667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 64/121] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:14 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:14.697617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:14.698233 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:14.704627 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.705096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.705537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.706216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.706652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.707062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.722460 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:14.841545 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:14.849438 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-40d600f1-2995-43eb-b57e-256ef9f6ceb0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.155574 Aug 25 05:14:14.854094 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 58/122] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:14 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:14.888880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:14.893611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:14.895513 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.895991 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.896405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.897080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:14.897517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:14.897967 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:14.960572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:14.968469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fcc93780-3e6a-4da1-bd13-60b85aa6134c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1241 microversion: 2.1 time: 0.084201 Aug 25 05:14:14.969023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 65/123] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:14 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:15.003309 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:15.003910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:15.015356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.015356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.015356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.015356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.015688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.015688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.072857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:15.082165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:15.083736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:15.084887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4018dd22-7080-4e45-a2bc-4bf167298159 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1285 microversion: 2.20 time: 0.085314 Aug 25 05:14:15.085443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 59/124] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:14 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:15.209906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:15.210553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:15.222402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.222933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.223366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.224072 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.224794 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.224919 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.296755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:15.297352 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:15.304062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.304537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.304962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.305667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.306266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.306827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.477538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:15.487698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-98628aa6-53d3-435b-a9ce-a15a2c91a107 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.281431 Aug 25 05:14:15.498957 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 66/125] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:15 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:15.558257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-ffba8176-0ae5-44b5-80c1-3b701d29e30a req-46cfbd7f-cc7a-4963-b5f5-43a8acb35911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c2d215-3277-4afa-a9af-3cb413c08b66", "name": "network-vif-plugged", "status": "completed", "tag": "49238283-70cb-4e19-9e70-188976abe7d3"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:15.562351 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:15.568540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ffba8176-0ae5-44b5-80c1-3b701d29e30a req-46cfbd7f-cc7a-4963-b5f5-43a8acb35911 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.569004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ffba8176-0ae5-44b5-80c1-3b701d29e30a req-46cfbd7f-cc7a-4963-b5f5-43a8acb35911 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.569422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ffba8176-0ae5-44b5-80c1-3b701d29e30a req-46cfbd7f-cc7a-4963-b5f5-43a8acb35911 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.570009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6efad035-67fe-49bf-9448-bab53b778c0c tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.278331 Aug 25 05:14:15.570572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 60/126] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:15 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:15.580935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-ffba8176-0ae5-44b5-80c1-3b701d29e30a req-46cfbd7f-cc7a-4963-b5f5-43a8acb35911 service nova] Creating event network-vif-plugged:49238283-70cb-4e19-9e70-188976abe7d3 for instance 28c2d215-3277-4afa-a9af-3cb413c08b66 on hv-cinder-85391 Aug 25 05:14:15.587464 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-ffba8176-0ae5-44b5-80c1-3b701d29e30a req-46cfbd7f-cc7a-4963-b5f5-43a8acb35911 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097337 Aug 25 05:14:15.588614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 67/127] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:15.870618 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:15.876644 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:15.877962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.878642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.879325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.880220 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.880846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.881443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.988643 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:15.990117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:15.996720 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.997445 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:15.998073 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:15.998939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:15.999611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:16.002391 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:16.115439 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:16.124414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-85383053-9dc2-4a98-b930-e8e3f5ddb493 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1233 microversion: 2.1 time: 0.139742 Aug 25 05:14:16.125646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 68/128] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:15 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1233 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:16.130662 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:16.131790 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:16.138802 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:16.140044 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:16.140621 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:16.141825 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:16.142432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:16.143037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:16.242766 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:16.253712 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6e21ee31-8d0b-4412-8d29-134a93fa6dee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.387097 Aug 25 05:14:16.254948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 61/129] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:15 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:16.281196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:16.290154 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:16.291729 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:16.292822 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6863c50b-2310-4b7c-a216-d5bb4a3509fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1277 microversion: 2.20 time: 0.166000 Aug 25 05:14:16.293383 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 69/130] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:16 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:16.509485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:16.509485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:16.520639 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:16.521142 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:16.521682 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:16.522600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:16.523132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:16.523542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:16.591734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:16.592346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:16.607121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:16.618455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:16.619228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:16.619972 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:16.620426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:16.620841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:16.750626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:16.756092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bf5c682e-10c4-48c1-ae33-a1e9ff24621f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.251924 Aug 25 05:14:16.770141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 62/131] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:16 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:16.811797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:16.819914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d274663b-4070-4081-b817-d8b2edf41644 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.232724 Aug 25 05:14:16.820777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 70/132] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:16 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:17.146581 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:17.147185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:17.154002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.154478 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.154904 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.155757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.156367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.156934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.229621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:17.237704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-74b91e09-daec-4a88-befa-31b017d45b17 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1297 microversion: 2.1 time: 0.094898 Aug 25 05:14:17.239851 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 63/133] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:17 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:17.275185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:17.275787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:17.279135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:17.291706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.292347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.292707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.293634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.294236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.294657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.318473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:17.319080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:17.354316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.354818 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.355262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.356025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.356964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.357381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.426810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:17.437793 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:17.439640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:17.441256 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-80e1ddbd-b3e9-4f9c-b12b-49c7d01338cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1333 microversion: 2.20 time: 0.127360 Aug 25 05:14:17.442197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 64/134] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:17 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:14:17.460941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:17.470851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f32e239a-296d-4ff3-b3de-5c52b4e15936 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.199540 Aug 25 05:14:17.471496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:17 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:17.779717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:17.780442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:17.783896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:17.793666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.794339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.798702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.798702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.798702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.798702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.843485 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:17.844470 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:17.854563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.855161 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.855839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:17.856808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:17.857458 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:17.860693 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:18.172955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:18.183590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f9ab14d6-c690-4473-a1fc-ed229aedf31a tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1315 microversion: 2.1 time: 0.345447 Aug 25 05:14:18.202888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 72/136] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:17 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:18.270021 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:18.270957 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:18.278766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:18.279348 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:18.279657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:18.280346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:18.280787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:18.281273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:18.360845 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:18.363674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=100 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:18.370092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fb9390bb-dc5e-4ba4-af1d-f63628f07e07 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1295 microversion: 2.1 time: 0.105838 Aug 25 05:14:18.382397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 73/137] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:18 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:18.398562 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:18.407883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-22d51244-7023-4bd0-aded-6190c7ff1948 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.633855 Aug 25 05:14:18.408692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 65/138] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:17 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:18.473310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:18.473983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:18.481002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:18.481657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:18.482592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:18.483409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:18.483975 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:18.484728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:18.492589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:18.493381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:18.503244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:18.505050 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:18.506016 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:18.507122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:18.508041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:18.508554 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:18.610663 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:18.617326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:18.619002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:18.620540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f3afbad3-2768-426b-b3da-5360e48e47a2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1339 microversion: 2.20 time: 0.152980 Aug 25 05:14:18.621099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 74/139] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:18 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1339 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:18.761834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:18.771617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-06f703e9-9025-43b0-90b6-cf0745256f7a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.284063 Aug 25 05:14:18.785624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 66/140] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:18 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:19.212034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:19.212704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:19.225177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.229622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.230244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.231698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.232305 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.232733 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.293220 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-7ffeae7e-d859-41b9-acd5-a027342e7f4c req-d5cb09de-a759-4c0b-b69f-5c77e463426f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3a8721-5c5c-411a-85f9-8ee33510ccb6", "name": "network-vif-plugged", "status": "completed", "tag": "89194eae-54f6-4cb6-81a1-0443f90b1835"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:19.314721 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7ffeae7e-d859-41b9-acd5-a027342e7f4c req-d5cb09de-a759-4c0b-b69f-5c77e463426f service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.315231 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7ffeae7e-d859-41b9-acd5-a027342e7f4c req-d5cb09de-a759-4c0b-b69f-5c77e463426f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.317343 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7ffeae7e-d859-41b9-acd5-a027342e7f4c req-d5cb09de-a759-4c0b-b69f-5c77e463426f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.331154 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-7ffeae7e-d859-41b9-acd5-a027342e7f4c req-d5cb09de-a759-4c0b-b69f-5c77e463426f service nova] Creating event network-vif-plugged:89194eae-54f6-4cb6-81a1-0443f90b1835 for instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 on hv-cinder-85391 Aug 25 05:14:19.337045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-7ffeae7e-d859-41b9-acd5-a027342e7f4c req-d5cb09de-a759-4c0b-b69f-5c77e463426f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048148 Aug 25 05:14:19.337809 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 67/141] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:14:19.427692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:19.432616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:19.447343 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.449338 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.475237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.479252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.481366 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.484760 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.570473 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:19.581105 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-231e5445-56d6-4c2f-8fa8-f366f2dd9428 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1502 microversion: 2.1 time: 0.373156 Aug 25 05:14:19.589738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 75/142] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:19 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1502 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:19.589738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:19.589738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:19.595996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.596696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.597273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.598344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.598936 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.599499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.918990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:19.931807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c52b0e6d-ac49-478e-b4ec-74d00479de16 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.348058 Aug 25 05:14:19.932905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 76/143] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:19 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:19.945179 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:19.947259 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:19.965319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.965724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.966165 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.966858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:19.967294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:19.967702 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:19.971010 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:19.987870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-894b3c42-b235-4d3f-a313-605fe5dc5621 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.594486 Aug 25 05:14:19.989008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 68/144] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:19 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:20.014295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:20.014906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:20.023395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:20.024235 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:20.028268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:20.028268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:20.028268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:20.028268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:20.118060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:20.127973 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:20.131074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:20.132258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-466a399c-d122-4506-a242-54f8d761e503 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1339 microversion: 2.20 time: 0.198205 Aug 25 05:14:20.132808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 77/145] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:19 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:20.292421 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:20.304500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0f98fccf-7eb6-43b0-8ec1-4f577dfe8ad4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.307571 Aug 25 05:14:20.305092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 69/146] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:19 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:20.954010 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:20.955395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-285ace48-03eb-41aa-85ae-6400b7cc87db req-150a5d66-8e15-42f4-b0c6-32520d935eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc100113-0ca3-4722-b59c-b725c79197cc", "tag": "49fe036d-972f-4829-a56e-3949f17aa88a"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:20.956053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:20.963360 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:20.964265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:20.964864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:20.965776 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:20.966371 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:20.966942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:20.967415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-285ace48-03eb-41aa-85ae-6400b7cc87db req-150a5d66-8e15-42f4-b0c6-32520d935eb0 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:20.968289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-285ace48-03eb-41aa-85ae-6400b7cc87db req-150a5d66-8e15-42f4-b0c6-32520d935eb0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:20.968929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-285ace48-03eb-41aa-85ae-6400b7cc87db req-150a5d66-8e15-42f4-b0c6-32520d935eb0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:20.986557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-285ace48-03eb-41aa-85ae-6400b7cc87db req-150a5d66-8e15-42f4-b0c6-32520d935eb0 service nova] Creating event network-changed:49fe036d-972f-4829-a56e-3949f17aa88a for instance cc100113-0ca3-4722-b59c-b725c79197cc on hv-cinder-85391 Aug 25 05:14:20.994448 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-285ace48-03eb-41aa-85ae-6400b7cc87db req-150a5d66-8e15-42f4-b0c6-32520d935eb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044036 Aug 25 05:14:20.997061 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 70/147] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:21.015639 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:21.017097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:21.023948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:21.024461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:21.025046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:21.029214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:21.029214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:21.029214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:21.160173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:21.168155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1827b160-1404-43d8-89b5-693dbd77aeff tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.218508 Aug 25 05:14:21.174254 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 78/148] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:20 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:21.177712 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:21.179223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:21.179939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:21.186841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:21.187322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:21.187749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:21.188435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:21.188878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:21.189261 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c39a5040-c0e6-49d2-ac5c-7f0571892e5a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.182797 Aug 25 05:14:21.189366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:21.193422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 71/149] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:21 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:21.331033 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:21.331647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:21.338519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:21.339465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:21.340104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:21.341480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:21.341815 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:21.345216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:21.357702 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:21.369710 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:21.371766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:21.377726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5f46a53f-e0ce-4245-a5ef-f6fbf94eabfb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.197695 Aug 25 05:14:21.377726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 79/150] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:21 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:21.500016 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:21.508755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c8b9979a-4077-4e87-ab0b-c27c5d044c50 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.181740 Aug 25 05:14:21.509343 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 72/151] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:21 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:22.189642 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:22.190951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:22.197379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.200483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.200483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.200483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.200483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.200842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.211807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:22.213352 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:22.221083 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.221806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.222403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.223814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.224415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.224978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.355321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:22.363135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1a226c7a-7b0f-4263-8c5a-37c33892024f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.175997 Aug 25 05:14:22.363770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 80/152] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:22 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:22.395941 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:22.404207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-12d27156-0f4a-428f-b72e-0130f45094fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.196916 Aug 25 05:14:22.404787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 73/153] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:22 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:22.406131 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:22.407639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:22.422213 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.429727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.429727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.429727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.429727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.430146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.536877 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:22.537779 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:22.544402 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.545082 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.545653 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.546446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.547098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.547623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.623019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:22.634687 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:22.636488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:22.637675 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-043deb5a-9acc-4d64-9154-b5c3727872b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.238841 Aug 25 05:14:22.638277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 81/154] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:22 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:22.709682 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:22.710196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7c294ec-19ca-4596-8275-14c5e9a463ea"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:22.713146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:22.721014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.721772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.722098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-69c366a1-ec2e-403d-8c52-c8ab9cd2cdc5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.190838 Aug 25 05:14:22.722212 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.722836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 74/155] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:22 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:22.722941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.723309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.724001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.768227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-e18e486f-a30c-4889-bc31-5fdb37054374 req-9713075f-8048-43a5-bfe8-441ceb681bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070a4cc0-c2a7-4e19-b265-7c540dc6f045", "tag": "918a320b-9189-42f8-9052-24cef6e0d004"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:22.786367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e18e486f-a30c-4889-bc31-5fdb37054374 req-9713075f-8048-43a5-bfe8-441ceb681bc4 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:22.787007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e18e486f-a30c-4889-bc31-5fdb37054374 req-9713075f-8048-43a5-bfe8-441ceb681bc4 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:22.787445 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e18e486f-a30c-4889-bc31-5fdb37054374 req-9713075f-8048-43a5-bfe8-441ceb681bc4 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:22.801297 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-e18e486f-a30c-4889-bc31-5fdb37054374 req-9713075f-8048-43a5-bfe8-441ceb681bc4 service nova] Creating event network-changed:918a320b-9189-42f8-9052-24cef6e0d004 for instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 on hv-cinder-85391 Aug 25 05:14:22.808406 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-e18e486f-a30c-4889-bc31-5fdb37054374 req-9713075f-8048-43a5-bfe8-441ceb681bc4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044372 Aug 25 05:14:22.809632 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 75/156] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:14:23.384995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:23.385546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:23.392285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.392760 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.393183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:23.393954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.394546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.395093 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:23.601977 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:23.611019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0f4b44d3-7627-47b2-a1c4-df85792adee8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.230792 Aug 25 05:14:23.611612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 76/157] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:23 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:23.616024 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:23.616616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:23.628694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.628694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.628694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:23.628694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.629167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.629167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:23.629167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:23.757816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:23.767639 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-be26c713-d1b9-4686-853f-2a0bdac706d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.154975 Aug 25 05:14:23.768241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 77/158] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:23 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:23.772980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:23.773579 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:23.784390 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.784985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.785449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:23.786191 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.786686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.787106 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:23.942816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:23.951660 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:23.953151 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:23.954266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f845aac3-bc59-4b11-a086-152bcbfa77ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.185120 Aug 25 05:14:23.954827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 78/159] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:23 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:23.959139 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:23.959729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:23.965516 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.966018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.966443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:23.967119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:23.967561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:23.967976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:24.104279 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:24.114282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-26864659-2e14-44ff-a4bf-faf098a47220 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.158417 Aug 25 05:14:24.130109 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 79/160] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:23 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:24.635551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:24.635551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:24.642389 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:24.642863 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:24.643311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:24.644070 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:24.644507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:24.644917 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:24.789509 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:24.797883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1f86621a-c497-40a6-ad4f-af161021e2db tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.168956 Aug 25 05:14:24.798556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 80/161] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:24 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:24.806955 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:24.807683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:24.814992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:24.815541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:24.816043 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:24.816800 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:24.817323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:24.817825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:25.092827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:25.101877 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-48aa0a07-99df-4b1a-8522-d7c8e6ad25d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.301759 Aug 25 05:14:25.102631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 81/162] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:24 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:25.109234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:25.110017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:25.122499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:25.123456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:25.124035 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:25.125289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:25.125953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:25.126679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:25.127155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b7a756a7-9e53-4856-930d-485b19a7ea8b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "POST /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.420838 Aug 25 05:14:25.128546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 82/163] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:14:22 2022] POST /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66/os-volume_attachments => generated 194 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:14:25.139223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:25.142172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:25.156686 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:25.167596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:25.168650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:25.171773 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:25.172320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:25.173644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:25.382842 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:25.392218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:25.393912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:25.397001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-91d277e0-26dd-41d5-baf6-6b4b5b6a5dba tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.291358 Aug 25 05:14:25.397001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 82/164] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:25 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:25.501737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-3e7872f3-161b-46d2-be01-7c1c023f28c8 req-276432d0-7cb4-45de-ada7-0f5f5a681a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00679982-187d-430a-908f-29644650feb4", "name": "network-vif-plugged", "status": "completed", "tag": "f5a8bbe4-e926-4999-b1e8-599f495bd711"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:25.529642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-3e7872f3-161b-46d2-be01-7c1c023f28c8 req-276432d0-7cb4-45de-ada7-0f5f5a681a95 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:25.530409 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-3e7872f3-161b-46d2-be01-7c1c023f28c8 req-276432d0-7cb4-45de-ada7-0f5f5a681a95 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:25.534262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-3e7872f3-161b-46d2-be01-7c1c023f28c8 req-276432d0-7cb4-45de-ada7-0f5f5a681a95 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:25.571768 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-3e7872f3-161b-46d2-be01-7c1c023f28c8 req-276432d0-7cb4-45de-ada7-0f5f5a681a95 service nova] Creating event network-vif-plugged:f5a8bbe4-e926-4999-b1e8-599f495bd711 for instance 00679982-187d-430a-908f-29644650feb4 on hv-cinder-85391 Aug 25 05:14:25.582292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-3e7872f3-161b-46d2-be01-7c1c023f28c8 req-276432d0-7cb4-45de-ada7-0f5f5a681a95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084349 Aug 25 05:14:25.587023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 83/165] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:25.637429 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:25.646202 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-85d439c0-0ae2-4d2e-b8ed-030f81559aad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.512020 Aug 25 05:14:25.646780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 83/166] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:25 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:25.822413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:25.834307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:25.841866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:25.842564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:25.843229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:25.844148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:25.844931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:25.845579 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:26.001611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:26.009718 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3aa2a7d3-1c40-4f2c-9c8e-578221beba63 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.193353 Aug 25 05:14:26.010300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 84/167] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:25 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:26.123653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:26.124668 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:26.131507 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:26.132813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:26.133454 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:26.134402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:26.135060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:26.135548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:26.319801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:26.330358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7349c24a-b1f4-4d81-a0b4-092c3578ce34 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.211012 Aug 25 05:14:26.333158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 84/168] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:26 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:26.419481 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:26.420092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:26.426020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:26.426486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:26.426905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:26.427582 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:26.428015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:26.428418 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:26.569012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:26.578379 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:26.579868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:26.580958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bea0e0c3-91c4-4f72-b212-83a3649e460d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.166417 Aug 25 05:14:26.581506 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 85/169] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:26 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:26.667305 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:26.667900 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:26.674372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:26.674848 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:26.675272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:26.682958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:26.682958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:26.682958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:26.833867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:26.846365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-15f2ca2f-ade5-40c0-83e8-5355653d56ca tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.182985 Aug 25 05:14:26.861387 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 85/170] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:26 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:27.040267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:27.040987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:27.048200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.050453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.050900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.051643 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.052096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.052567 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.212341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:27.225561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4e85accc-64b6-4d2f-82c8-b0344186253c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.198124 Aug 25 05:14:27.230132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 86/171] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:27 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:27.353905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:27.354503 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:27.363999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.363999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.363999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.363999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.364274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.364274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.609479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:27.610528 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:27.622179 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.622660 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.623076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.624401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.628947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.628947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.658768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:27.670543 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4b3c9c5b-3897-4a24-869e-78cc164d0583 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.320398 Aug 25 05:14:27.676921 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 86/172] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:27 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:27.699028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-8b11ae4e-adad-4059-9f38-b7805b5d3444 req-09749b83-0243-4be1-8d41-2eb77241eb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a769edb-35d4-41ea-866f-3eb74f13e938", "name": "network-vif-plugged", "status": "completed", "tag": "998258dc-63e3-42e3-b67d-ae2e1b94e7e8"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:27.715706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8b11ae4e-adad-4059-9f38-b7805b5d3444 req-09749b83-0243-4be1-8d41-2eb77241eb86 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.719234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8b11ae4e-adad-4059-9f38-b7805b5d3444 req-09749b83-0243-4be1-8d41-2eb77241eb86 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.719234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8b11ae4e-adad-4059-9f38-b7805b5d3444 req-09749b83-0243-4be1-8d41-2eb77241eb86 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.728093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-8b11ae4e-adad-4059-9f38-b7805b5d3444 req-09749b83-0243-4be1-8d41-2eb77241eb86 service nova] Creating event network-vif-plugged:998258dc-63e3-42e3-b67d-ae2e1b94e7e8 for instance 6a769edb-35d4-41ea-866f-3eb74f13e938 on hv-cinder-85391 Aug 25 05:14:27.733126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-8b11ae4e-adad-4059-9f38-b7805b5d3444 req-09749b83-0243-4be1-8d41-2eb77241eb86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041365 Aug 25 05:14:27.733747 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 87/173] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:14:27.848838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:27.858459 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:27.860076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:27.861492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3481cafe-7738-4b80-849f-0ad4e4d08efa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.260430 Aug 25 05:14:27.862304 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 87/174] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:27 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:27.871816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:27.872509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:27.879101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.879906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.880590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:27.881446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:27.882065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:27.882385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:28.028662 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:28.037754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3270d323-5b57-4174-9caa-97faec464c8c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.170507 Aug 25 05:14:28.038659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 88/175] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:27 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:28.249316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:28.250116 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:28.256300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:28.256854 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:28.257340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:28.258370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:28.258878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:28.259413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:28.409411 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:28.417234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-57961580-724b-4582-9f6f-5def8737b06b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.172662 Aug 25 05:14:28.418709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 88/176] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:28 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:28.702407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:28.704071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:28.708788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:28.709260 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:28.709770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:28.710444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:28.710886 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:28.711293 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:28.848596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:28.851126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:28.859475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d52fdb6a-4fdd-4f79-abf3-92cb89077487 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.161297 Aug 25 05:14:28.860071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 89/177] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:28 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:28.884171 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:28.884777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:28.891244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:28.891863 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:28.897368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:28.897368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:28.897368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:28.897368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:29.066006 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:29.066615 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:29.080135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:29.080250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:29.080250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:29.080250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:29.080927 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:29.081348 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:29.082259 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:29.087774 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:29.090229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:29.091921 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-41dc5e4b-2c62-4538-afe8-e34a4e4d8ee4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.211650 Aug 25 05:14:29.092960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 89/178] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:28 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:29.276074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:29.290382 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-067226ca-ce70-4548-bc17-1991f846dbe3 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.232771 Aug 25 05:14:29.291099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:29 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:29.437986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:29.438583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:29.444808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:29.445284 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:29.445750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:29.446451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:29.446892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:29.447306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:29.583540 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:29.591585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3d18323e-a782-4ff1-bdae-96f9e9ef592d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.157592 Aug 25 05:14:29.592152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 90/180] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:29 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:29.886249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:29.886249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:29.889718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:29.890749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:29.891414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:29.892252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:29.892772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:29.893618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:30.025371 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:30.033467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5f838d5a-b35b-406f-8df8-5a1bb3a977e4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.157250 Aug 25 05:14:30.034065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:29 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:30.114018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:30.114615 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:30.121095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:30.121563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:30.122012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:30.122685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:30.123282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:30.125720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:30.263216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:30.271539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:30.273133 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:30.274476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f12a9149-5b79-47d5-aa2e-ca5441091fcc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.164151 Aug 25 05:14:30.275136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 91/182] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:30 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:30.311658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:30.312257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:30.318080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:30.318480 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:30.318901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:30.319619 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:30.320159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:30.320505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:30.467010 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:30.474696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e216dbc7-a536-4c94-8f05-e5e801ae9a0a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.167105 Aug 25 05:14:30.475261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 92/183] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:30 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:30.614724 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:30.615338 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:30.622384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:30.622853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:30.623270 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:30.623952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:30.624393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:30.624804 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:30.779898 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:30.787027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f629a83f-fd4e-404b-b874-a53bb47a4c9c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.176424 Aug 25 05:14:30.787600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:30 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:31.054115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:31.054776 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:31.062017 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.062495 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.062920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.063615 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.064058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.064476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.194780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:31.202864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4a7fd754-92c2-46f5-812c-5e1c62ebb616 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.152878 Aug 25 05:14:31.203434 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 93/185] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:31 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:31.298855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:31.300725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:31.306345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.306835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.307258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.308111 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.308741 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.309347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.447686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:31.456088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:31.457850 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:31.459118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c86d16f1-6771-4697-98e3-3868522bb5ac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.164113 Aug 25 05:14:31.459699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 93/186] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:31 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:31.495632 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:31.496261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:31.502761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.503277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.503711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.504537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.504983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.505395 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.637258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:31.644827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2b6d9c1c-5fa6-4517-b08e-a25695d3fcc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.153083 Aug 25 05:14:31.645399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 94/187] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:31 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:31.807883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:31.809058 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:31.815062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.815538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.815960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.816678 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:31.817118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:31.817531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:31.832120 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:31.953504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:31.961189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1bd9370e-965b-4226-a727-957c40e8227f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.157171 Aug 25 05:14:31.961792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 94/188] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:31 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:32.224532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:32.224532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:32.231636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.232119 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.232550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:32.233236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.233708 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.234126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:32.364245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:32.372508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-926a5981-9ca7-47aa-9586-f0fab802fda2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.152848 Aug 25 05:14:32.384948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 95/189] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:32 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:32.481996 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:32.482596 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:32.488883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.489351 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.489848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:32.490547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.490990 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.491399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:32.616234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:32.624879 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:32.626427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:32.627502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0e003867-3fb9-426f-9529-de64d233c192 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.150167 Aug 25 05:14:32.628055 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 95/190] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:32 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:32.664465 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:32.665180 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:32.672069 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.672539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.673041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:32.673782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.674275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.674698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:32.811217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:32.819253 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4a93dd88-2bee-4308-8319-2403580c422f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.158366 Aug 25 05:14:32.819747 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 96/191] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:32 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:32.983400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:32.984007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:32.990030 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.990510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.991028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:32.991606 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:32.992052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:32.992466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:33.120751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:33.128242 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f24bb99f-ca52-4637-9e8c-791cde02d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.149346 Aug 25 05:14:33.128807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 96/192] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:32 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:33.393954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:33.394616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:33.401097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:33.401599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:33.402035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:33.402974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:33.403420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:33.403825 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:33.540369 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:33.548695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3148258b-778c-4e26-b8df-8e93d26fb988 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.159029 Aug 25 05:14:33.549246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 97/193] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:33 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:33.650298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:33.650939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:33.657613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:33.658078 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:33.658496 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:33.659175 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:33.659620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:33.660269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:33.797504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:33.805868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:33.807412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:33.808551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5ad90765-3311-4084-b5cc-6e79695cf5cf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.162130 Aug 25 05:14:33.809111 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 97/194] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:33 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:33.843134 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:33.843811 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:33.849804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:33.850271 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:33.850690 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:33.851388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:33.851824 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:33.852230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:33.979309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:33.987128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4c56151f-8e2d-4451-be54-8d1fa410b264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1321 microversion: 2.1 time: 0.148471 Aug 25 05:14:33.987705 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:33 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:34.148244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:34.148847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:34.155391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:34.155869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:34.156297 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:34.157009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:34.157456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:34.157907 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:34.285216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:34.292897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-95d03028-f66e-4f17-bf88-73de5da2796e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.148523 Aug 25 05:14:34.293473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 98/196] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:34 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:34.569049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:34.569565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:34.576658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:34.577128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:34.577550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:34.578243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:34.578683 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:34.580870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:34.713212 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:34.721246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cb1a29ad-d8bb-45fe-ae89-2e978d29e336 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.156116 Aug 25 05:14:34.721909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 99/197] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:34 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:34.841982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:34.842371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:34.848813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:34.850604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:34.850604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:34.850604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:34.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:34.851250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.015146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:35.024026 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:35.025135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:35.036995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:35.038617 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.038914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:35.039109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.039566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.040259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8ec90566-af2f-4dca-bc4c-fd00ec135d1b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.212216 Aug 25 05:14:35.040360 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.040700 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.044581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.055166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 99/198] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:34 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:35.198015 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:35.205765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5114c570-23ca-47c4-b1fd-23b81d3042fc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1514 microversion: 2.1 time: 0.196505 Aug 25 05:14:35.206540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 100/199] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:35 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:35.235505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:35.237787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:35.243655 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.244155 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.244586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.245296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.245792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.246855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.307359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lazy-loading 'flavor' on Instance uuid 00679982-187d-430a-908f-29644650feb4 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:14:35.314135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:35.314756 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:35.320677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.321150 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.321572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.322281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.322726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.323134 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.455572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:35.463520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1d561440-5c44-463b-9ad1-f6120cfe680b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.153147 Aug 25 05:14:35.477478 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 101/200] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:35 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:35.741701 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:35.742320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:35.750849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.751327 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.751752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.752463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:35.752908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:35.753327 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:35.878944 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:35.887626 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-30609493-e975-4616-bcb0-f7a578d0beb0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.149603 Aug 25 05:14:35.888187 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 102/201] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:35 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:36.061436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-40b1683e-0aab-42cc-825c-150e3c458961 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4/action" status: 200 len: 32 microversion: 2.1 time: 0.830037 Aug 25 05:14:36.064416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 100/202] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:14:35 2022] POST /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4/action => generated 32 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:14:36.067625 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:36.068497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:36.078683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:36.081037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.082042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.082175 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.083667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.083950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:36.084592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.087553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.106692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.107252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.107698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.108764 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.109226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.109659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.234665 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:36.245226 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:36.247613 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:36.248717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bbb9ba85-85c9-4d34-b373-e41dba2cd840 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.187760 Aug 25 05:14:36.249262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 103/203] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:36 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:14:36.253863 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-112adc3b-d135-4340-9047-36e4c1a7cba9 req-bb84624b-e583-4a93-9bc2-7ddc9633feb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070a4cc0-c2a7-4e19-b265-7c540dc6f045", "name": "network-vif-plugged", "status": "completed", "tag": "918a320b-9189-42f8-9052-24cef6e0d004"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:36.264257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-112adc3b-d135-4340-9047-36e4c1a7cba9 req-bb84624b-e583-4a93-9bc2-7ddc9633feb7 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.269726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-112adc3b-d135-4340-9047-36e4c1a7cba9 req-bb84624b-e583-4a93-9bc2-7ddc9633feb7 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.269726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-112adc3b-d135-4340-9047-36e4c1a7cba9 req-bb84624b-e583-4a93-9bc2-7ddc9633feb7 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.276882 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-112adc3b-d135-4340-9047-36e4c1a7cba9 req-bb84624b-e583-4a93-9bc2-7ddc9633feb7 service nova] Creating event network-vif-plugged:918a320b-9189-42f8-9052-24cef6e0d004 for instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 on hv-cinder-85391 Aug 25 05:14:36.281153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:36.282323 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-112adc3b-d135-4340-9047-36e4c1a7cba9 req-bb84624b-e583-4a93-9bc2-7ddc9633feb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 Aug 25 05:14:36.282920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 104/204] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:36.291322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-87123297-8d35-4ecc-a77f-b06931d24523 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.219381 Aug 25 05:14:36.291977 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 101/205] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:36 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:36.486311 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:36.487190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:36.494682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.495281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.495826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.497177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.497870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.498560 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.643404 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:36.651149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-942f1a5f-c518-4149-90e7-2038f358b2f8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.170384 Aug 25 05:14:36.651704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 105/206] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:36 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:36.908695 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:36.909293 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:36.915239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.915715 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.916146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:36.916824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:36.917269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:36.917719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:37.063218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:37.071182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b4953768-1d3f-4940-87df-176eb124d2b9 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.166266 Aug 25 05:14:37.071845 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 102/207] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:36 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:37.271389 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:37.271917 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:37.278215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:37.278679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:37.279142 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:37.279816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:37.280280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:37.280688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:37.312778 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:37.313786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:37.319988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:37.320528 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:37.321028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:37.321805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:37.322445 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:37.322930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:37.411308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:37.420132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:37.422121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:37.422899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8ab006e6-24bd-4967-9e52-e9e6debe3fca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.155394 Aug 25 05:14:37.423828 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 106/208] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:37 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:37.466405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:37.478282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8ec2bfce-3f17-4ddc-898e-78ef4c90f5ff tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.169939 Aug 25 05:14:37.478843 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 103/209] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:37 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:37.672144 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:37.672706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:37.678681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:37.679183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:37.679607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:37.680275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:37.680709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:37.681117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:37.685128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=100 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:37.813034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:37.820493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cee6cb6f-f2f8-47bf-9cba-b4c9876db254 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1367 microversion: 2.1 time: 0.152775 Aug 25 05:14:37.821085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 107/210] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:37 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:38.093067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:38.093847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:38.100395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.101052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.101583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.102299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.102750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.103164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.233305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:38.241118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-eb5ea0ef-0a28-483f-b87a-7757d40df9e0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.152801 Aug 25 05:14:38.241750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 104/211] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:38 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:38.447477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:38.448066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:38.455036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.455513 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.455960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.457042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.457611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.457925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.467197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-585b5624-23bc-4c0c-af83-f76152316394 req-1bc268a1-d99b-4287-94fd-cc500da75179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc100113-0ca3-4722-b59c-b725c79197cc", "name": "network-vif-plugged", "status": "completed", "tag": "49fe036d-972f-4829-a56e-3949f17aa88a"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:38.477451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-585b5624-23bc-4c0c-af83-f76152316394 req-1bc268a1-d99b-4287-94fd-cc500da75179 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.478244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-585b5624-23bc-4c0c-af83-f76152316394 req-1bc268a1-d99b-4287-94fd-cc500da75179 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.478758 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-585b5624-23bc-4c0c-af83-f76152316394 req-1bc268a1-d99b-4287-94fd-cc500da75179 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.493419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-585b5624-23bc-4c0c-af83-f76152316394 req-1bc268a1-d99b-4287-94fd-cc500da75179 service nova] Creating event network-vif-plugged:49fe036d-972f-4829-a56e-3949f17aa88a for instance cc100113-0ca3-4722-b59c-b725c79197cc on hv-cinder-85391 Aug 25 05:14:38.503278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-585b5624-23bc-4c0c-af83-f76152316394 req-1bc268a1-d99b-4287-94fd-cc500da75179 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Aug 25 05:14:38.503278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 105/212] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:14:38.505796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:38.506449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:38.512747 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.513250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.513705 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.514401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.514861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.515279 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.665714 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:38.666934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:38.677112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:38.678730 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:38.679956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e416e081-3aae-4c38-8284-aba11661b680 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.236373 Aug 25 05:14:38.707844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 108/213] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:38 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:38.708739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-20c49e83-4348-4fc9-8cb1-e71dc1867887 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.205282 Aug 25 05:14:38.710009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 106/214] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:38 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:38.842492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:38.843093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:38.848868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.849340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.854347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.854347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:38.854347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:38.854347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:38.987120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:38.994974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f4e17efa-f398-4892-b211-a6bbf3d227ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1556 microversion: 2.1 time: 0.157143 Aug 25 05:14:38.995533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 109/215] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:38 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:39.019998 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:39.020485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:39.026458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.026922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.027870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.028536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.028973 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.029496 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.108248 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fc520879-fbe9-4172-ab99-a224647acd8c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092031 Aug 25 05:14:39.108839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 107/216] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:14:39 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:39.260642 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:39.261246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:39.279943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.284985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.284985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.284985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.284985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.285393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.518020 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:39.528413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ae11f1c7-da38-4868-a09f-cb0f5e6acff3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.271453 Aug 25 05:14:39.529067 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 110/217] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:39 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:39.702764 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:39.703416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:39.709506 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.710068 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.710495 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.711171 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.711611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.712018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.733989 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:39.735221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:39.743074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.744130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.744608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.745281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:39.745767 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:39.746672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:39.862647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:39.872535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:39.874736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:39.876190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c9c40a48-b15b-454d-954b-57fd0c371af6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.177878 Aug 25 05:14:39.876890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 108/218] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:39 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:40.247322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:40.257074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1b4e715e-fcc9-4c44-930c-961e55da2a8f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.529452 Aug 25 05:14:40.257873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 111/219] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:39 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:40.549366 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:40.550000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:40.555851 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:40.556335 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:40.556735 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:40.557401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:40.557872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:40.558282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:40.844914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:40.863295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dd3de79a-71b7-4a11-a064-da8b6958d2d5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.308995 Aug 25 05:14:40.863295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 109/220] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:40 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:40.901702 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:40.903958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:40.911376 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:40.912009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:40.912433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:40.913118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:40.913867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:40.914425 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:41.067693 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-b0716134-b837-488f-83fd-331ab7fa82e0 req-77c411a3-e482-443e-840f-5426716442bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a769edb-35d4-41ea-866f-3eb74f13e938", "tag": "998258dc-63e3-42e3-b67d-ae2e1b94e7e8"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:41.079299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-b0716134-b837-488f-83fd-331ab7fa82e0 req-77c411a3-e482-443e-840f-5426716442bc service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:41.080075 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-b0716134-b837-488f-83fd-331ab7fa82e0 req-77c411a3-e482-443e-840f-5426716442bc service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:41.080657 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-b0716134-b837-488f-83fd-331ab7fa82e0 req-77c411a3-e482-443e-840f-5426716442bc service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:41.085057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:41.095437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-b0716134-b837-488f-83fd-331ab7fa82e0 req-77c411a3-e482-443e-840f-5426716442bc service nova] Creating event network-changed:998258dc-63e3-42e3-b67d-ae2e1b94e7e8 for instance 6a769edb-35d4-41ea-866f-3eb74f13e938 on hv-cinder-85391 Aug 25 05:14:41.102463 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-b0716134-b837-488f-83fd-331ab7fa82e0 req-77c411a3-e482-443e-840f-5426716442bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037962 Aug 25 05:14:41.103662 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 110/221] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:14:41.130667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:41.141538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:41.145492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:41.145492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8601ed85-e328-446c-b433-9a11f754469c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1406 microversion: 2.20 time: 0.247990 Aug 25 05:14:41.145492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 112/222] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:40 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:41.283225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:41.284083 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:41.307025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:41.307487 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:41.307915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:41.309341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:41.309862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:41.311722 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:41.550534 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:41.558203 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b73d25f8-8935-4ee4-8e9e-665ca46d4236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.282852 Aug 25 05:14:41.559000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 111/223] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:41 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:41.882491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:41.883033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:41.890862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:41.891356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:41.891791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:41.892541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:41.892993 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:41.894933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:42.042880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:42.051520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0d21e762-cf5e-4c40-91e5-014e224aeabc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.173416 Aug 25 05:14:42.052356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 113/224] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:41 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:42.169533 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:42.171357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:42.180558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:42.181993 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:42.182618 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:42.184024 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:42.184628 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:42.185210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:42.335825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:42.344343 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:42.345867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:42.350882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2da20208-ce5c-4328-839d-6840a94e1c39 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1599 microversion: 2.20 time: 0.183775 Aug 25 05:14:42.350882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 112/225] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:14:42 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:14:42.371754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:42.372266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:42.378559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:42.379043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:42.379473 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:42.380196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:42.380650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:42.381060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:42.467648 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-20baccd7-ba9e-41a8-ba04-496946669050 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101465 Aug 25 05:14:42.468272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 114/226] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Aug 25 05:14:42 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:14:42.583241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:42.583857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:42.595650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:42.596145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:42.596581 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:42.597286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:42.597778 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:42.598200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:43.064706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:43.073057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c91a1336-ea29-4d25-aad4-5f1e5596289e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.497690 Aug 25 05:14:43.073482 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:43.074185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:43.080257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:43.080738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:43.081175 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:43.081902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:43.082359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:43.082793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:43.086191 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 113/227] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:42 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:43.268394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:43.276949 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8c4de5ab-7680-4601-9bde-918a94a718d2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.207863 Aug 25 05:14:43.277614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 115/228] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:43 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:44.099718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-e08c0ae3-0b9b-4f7c-a5c0-79ca4bb4bd19 req-18f93a1c-86e7-4418-ae10-386d1996e931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070a4cc0-c2a7-4e19-b265-7c540dc6f045", "tag": "918a320b-9189-42f8-9052-24cef6e0d004"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:44.102729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:44.105439 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:44.124549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:44.127972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:44.128869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:44.131599 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:44.133702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:44.134132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:44.139325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-e08c0ae3-0b9b-4f7c-a5c0-79ca4bb4bd19 req-18f93a1c-86e7-4418-ae10-386d1996e931 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:44.141201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-e08c0ae3-0b9b-4f7c-a5c0-79ca4bb4bd19 req-18f93a1c-86e7-4418-ae10-386d1996e931 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:44.141201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-e08c0ae3-0b9b-4f7c-a5c0-79ca4bb4bd19 req-18f93a1c-86e7-4418-ae10-386d1996e931 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:44.153529 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-e08c0ae3-0b9b-4f7c-a5c0-79ca4bb4bd19 req-18f93a1c-86e7-4418-ae10-386d1996e931 service nova] Creating event network-changed:918a320b-9189-42f8-9052-24cef6e0d004 for instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 on hv-cinder-85391 Aug 25 05:14:44.159037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-e08c0ae3-0b9b-4f7c-a5c0-79ca4bb4bd19 req-18f93a1c-86e7-4418-ae10-386d1996e931 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062984 Aug 25 05:14:44.159634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 116/229] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:44.304504 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:44.305658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:44.316976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:44.318770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:44.319264 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:44.319692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:44.323532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:44.325016 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:44.326851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:44.334918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7790ed5a-eda4-428e-bc6c-82d0f5b69fa0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.243265 Aug 25 05:14:44.335517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 114/230] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:44 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:44.538896 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:44.547410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6ba4b91c-79e0-4b53-a296-118e5112cf97 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.252169 Aug 25 05:14:44.551050 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 117/231] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:44 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:45.356734 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:45.357339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:45.359395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:45.364311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:45.364812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:45.365237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:45.366221 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:45.366855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:45.367465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:45.521566 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:45.531518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4ac8b113-2a24-40a5-9628-186840dcade1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.179011 Aug 25 05:14:45.536455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 115/232] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:45 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:45.567844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:45.568414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:45.574945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:45.575505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:45.575941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:45.576667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:45.577492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:45.577492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:45.724364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:45.732358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c13cd6b1-7f19-4487-b2c1-c9a24df47fed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.168425 Aug 25 05:14:45.733285 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 118/233] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:45 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:46.553483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:46.554205 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:46.563509 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:46.564773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:46.565474 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:46.566417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:46.567066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:46.567709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:46.754990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:46.755594 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:46.762475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:46.763138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:46.763786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:46.764718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:46.765295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:46.765958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:46.820463 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:46.829767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-017571a2-4dc4-4b50-963d-8000a042f4ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.281295 Aug 25 05:14:46.830544 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 116/234] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:46 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:46.901005 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:46.909070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-671e98ce-9c65-43a4-8021-7adf2cedfb4b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.157823 Aug 25 05:14:46.909836 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 119/235] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:46 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:47.850789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:47.857533 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:47.858020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:47.858636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:47.859065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:47.859748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:47.860362 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:47.860783 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:47.930576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:47.931249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:47.939258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:47.939950 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:47.940548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:47.941390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:47.942035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:47.942716 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:48.026527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:48.040304 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c61195ce-0016-4ac8-870c-0123dc96447c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.193284 Aug 25 05:14:48.041302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 117/236] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:47 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:48.123849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:48.131736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1e2bc74f-519d-4c33-80c2-a6bce0470aab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.205422 Aug 25 05:14:48.133376 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 120/237] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:47 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:49.060531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:49.061094 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:49.067007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:49.067529 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:49.067956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:49.068631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:49.069069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:49.069481 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:49.153217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:49.153998 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:49.156536 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=99 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:49.163080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:49.163688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:49.164215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:49.165218 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:49.165770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:49.166275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:49.201755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:49.210551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5661c120-9579-4901-80f0-200b5c2cec29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.153906 Aug 25 05:14:49.211131 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 118/238] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:49 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:49.315406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:49.323426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9d1bfd5b-23b0-4935-98d5-b34c76e23bf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.174774 Aug 25 05:14:49.324608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 121/239] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:49 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:50.233052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:50.233719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:50.239647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:50.240117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:50.240602 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:50.241298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:50.241773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:50.242186 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:50.347815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:50.348497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:50.362314 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:50.362924 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:50.363355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:50.364236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:50.364684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:50.365119 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:50.398100 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:50.406988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a8a93056-c5a2-4a31-b993-afe3d52de80f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.178360 Aug 25 05:14:50.414563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 119/240] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:50 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:50.501379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:50.509140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a3296841-0f90-4b2b-acdb-088db05ea9f6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.166263 Aug 25 05:14:50.510063 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 122/241] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:50 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:51.433680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:51.434349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:51.440730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:51.441386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:51.441871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:51.442726 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:51.443174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:51.443593 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:51.530206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:51.531338 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:51.546184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:51.546671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:51.547102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:51.547803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:51.548255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:51.549006 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:51.581375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:51.589561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-75e54227-ed7e-467f-95fc-d1f312b34594 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.159697 Aug 25 05:14:51.590162 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 120/242] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:51 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:51.677134 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:51.685303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-668c6582-5b02-4e07-9fd9-402c4c82a5d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.159575 Aug 25 05:14:51.685908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 123/243] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:51 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:52.609943 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:52.610489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:52.616435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:52.616911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:52.617372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:52.618083 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:52.618527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:52.618944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:52.705965 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:52.706563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:52.712926 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:52.713398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:52.713858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:52.715613 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:52.715909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:52.716316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:52.764165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:52.773828 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a3f3e0f9-195c-4c0e-a907-9d0dd7d66577 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.168156 Aug 25 05:14:52.774417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 121/244] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:52 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:52.851292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:52.853494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=100 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:52.859425 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-476a1428-4e28-447e-94d2-64fcc0b167cc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.157305 Aug 25 05:14:52.860039 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:52 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:53.795476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:53.796176 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:53.802119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:53.802586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:53.803007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:53.810198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:53.810198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:53.810198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:53.880323 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:53.881388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:53.887952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:53.888424 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:53.888842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:53.889516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:53.891684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:53.891684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:53.931969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:53.940468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a1a065c5-1aea-46e6-8270-f7759ec463ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.148788 Aug 25 05:14:53.941069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 122/246] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:53 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:54.016090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:54.023633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5c8e6ca8-4ad5-42d6-abc6-3a900e7bc17d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.147563 Aug 25 05:14:54.024200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 125/247] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:53 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:54.344133 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1988836316", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "networks": [{"uuid": "9e3c45bf-ee3e-4ac8-a35e-7c209d55d11f"}]}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:54.396754 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] validate_networks() for [('9e3c45bf-ee3e-4ac8-a35e-7c209d55d11f', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:14:54.779393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:14:54.779812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:14:54.780280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:14:54.780684 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:14:54.781122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:14:54.790946 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:54.791355 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:54.791815 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:54.792535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:54.792983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:54.793430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:54.810659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Getting quotas for project a252c620742a4f6b9fdaafb4cb81f10f. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:14:54.814730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Getting quotas for user 5be22eb85b3b4828a36edc6e1fcc05f7 and project a252c620742a4f6b9fdaafb4cb81f10f. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:14:54.827000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:14:54.829157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:14:54.961986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:54.962679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:54.970763 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:54.970763 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:54.971025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:54.971621 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:54.972092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:54.972510 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:55.069872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ef974ea1-5499-4ca7-9fd5-7a96d19ab091 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723686 Aug 25 05:14:55.071030 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 123/248] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:14:55.076374 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:55.076966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:55.083324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:55.084029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:55.084470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:55.085175 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:55.085679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:55.086829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:55.259877 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:55.269141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0f8eb875-b3c9-4cc8-b594-d8abe436eb95 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.196946 Aug 25 05:14:55.269877 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 124/249] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:55 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:55.283784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e510a107-46f3-4441-bc5c-03d5312500b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:55.284461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e510a107-46f3-4441-bc5c-03d5312500b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:55.340810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e510a107-46f3-4441-bc5c-03d5312500b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:55.348823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e510a107-46f3-4441-bc5c-03d5312500b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1214 microversion: 2.1 time: 0.077618 Aug 25 05:14:55.349492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 125/250] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:55 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:55.368932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:55.377670 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-43d44b24-91d4-46f4-8ef9-2a71b9a8c9b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.419760 Aug 25 05:14:55.378245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 126/251] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:54 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:56.289745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:56.290371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:56.296332 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:56.296824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:56.297237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:56.297946 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:56.298391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:56.302426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:56.374176 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3a66f21d-fc3d-4aa0-b837-4dfe02f22421 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:56.374777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3a66f21d-fc3d-4aa0-b837-4dfe02f22421 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:56.434906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3a66f21d-fc3d-4aa0-b837-4dfe02f22421 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:56.443708 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3a66f21d-fc3d-4aa0-b837-4dfe02f22421 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1214 microversion: 2.1 time: 0.076227 Aug 25 05:14:56.444357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 127/252] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:56 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:56.449941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:56.450809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:56.457416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:56.457920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:56.458344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:56.459036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:56.459475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:56.459885 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:56.604794 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:56.624813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cac430ae-2da4-4e97-b6a2-a94c886e1441 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.179239 Aug 25 05:14:56.625432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 128/253] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:56 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:56.657327 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:56.665087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bf9a076f-c948-452d-86e5-95332505fae8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1363 microversion: 2.1 time: 0.379129 Aug 25 05:14:56.665666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 126/254] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:56 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:57.420209 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:57.420771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:57.427301 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.427828 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.428232 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.428918 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.429364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.429814 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.456395 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:14:57.464194 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:57.465216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:57.471177 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.471727 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.472229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.472984 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.473505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.474455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.539331 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:57.548124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-830c5c3a-aac7-4d70-8107-fb1ffbfe906e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1266 microversion: 2.1 time: 0.087703 Aug 25 05:14:57.548981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 127/255] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:57 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:57.646238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:57.646877 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:57.652793 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.653257 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.653713 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.654379 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.654817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.655226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.804609 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:57.812891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4b5388b9-737e-49e4-bacb-93417d1e08b4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.170656 Aug 25 05:14:57.813500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 128/256] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:57 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:57.817914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:57.818514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:57.823820 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-90c53ccd-a614-413f-a285-d6ab8eb17bc6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 204 len: 0 microversion: 2.1 time: 0.404752 Aug 25 05:14:57.823820 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 129/257] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:14:57 2022] DELETE /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:14:57.825704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.826355 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.826942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.827958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.828421 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.828839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.830772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:57.831686 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:57.831980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:14:57.838074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.838601 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.839116 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.840387 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:57.841024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:57.841471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:57.987215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:57.996536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bd63013d-7fe5-4c8e-ab0a-d43211d163be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1550 microversion: 2.1 time: 0.181917 Aug 25 05:14:57.997124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 129/258] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:57 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:58.009923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:58.018036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:58.018271 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-56d9c632-bbd8-44a9-b331-d5bf42a4255b tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.191620 Aug 25 05:14:58.018526 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:58.018834 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 130/259] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:57 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:58.024569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:58.025047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:58.025476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:58.026194 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:58.026646 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:58.027128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:58.104117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f8f4544e-5365-4730-b684-07647180affd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089798 Aug 25 05:14:58.112624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 130/260] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:14:58 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:14:58.572320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:58.572928 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:58.580053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:58.580053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:58.580462 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:58.581136 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:58.581605 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:58.582032 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:58.642733 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:58.653339 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e0e3ed37-c42d-4b88-9ef9-4343558ec7c5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1274 microversion: 2.1 time: 0.084874 Aug 25 05:14:58.653946 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 131/261] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:58 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:58.834680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:58.835341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:58.842412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:58.842965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:58.843455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:58.844203 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:58.844712 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:58.845217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:59.039913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:59.040530 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:59.049031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:59.049510 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:59.049961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:59.050677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:59.051121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:59.052516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:59.058002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:59.069782 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-776381cd-1b0c-42c4-9aa6-8e8938e20976 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.238310 Aug 25 05:14:59.070907 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 131/262] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:58 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:14:59.210059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:59.219455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e1a7e87e-2eef-4061-b294-264a41496f69 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.183427 Aug 25 05:14:59.220234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 132/263] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:59 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:14:59.262661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-8bb709e2-95c6-4235-8b74-c63f867323fd req-23c96f21-9c62-45c5-aed7-824dbb7811c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc100113-0ca3-4722-b59c-b725c79197cc", "tag": "49fe036d-972f-4829-a56e-3949f17aa88a"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:14:59.271988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-8bb709e2-95c6-4235-8b74-c63f867323fd req-23c96f21-9c62-45c5-aed7-824dbb7811c1 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:59.272544 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-8bb709e2-95c6-4235-8b74-c63f867323fd req-23c96f21-9c62-45c5-aed7-824dbb7811c1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:59.273031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-8bb709e2-95c6-4235-8b74-c63f867323fd req-23c96f21-9c62-45c5-aed7-824dbb7811c1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:59.285257 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-8bb709e2-95c6-4235-8b74-c63f867323fd req-23c96f21-9c62-45c5-aed7-824dbb7811c1 service nova] Creating event network-changed:49fe036d-972f-4829-a56e-3949f17aa88a for instance cc100113-0ca3-4722-b59c-b725c79197cc on hv-cinder-85391 Aug 25 05:14:59.292527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-8bb709e2-95c6-4235-8b74-c63f867323fd req-23c96f21-9c62-45c5-aed7-824dbb7811c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032094 Aug 25 05:14:59.292527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 132/264] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:14:59.674967 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:14:59.675323 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:14:59.685090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:59.685577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:59.689528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:59.690364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:14:59.692326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:14:59.692767 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:14:59.790017 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:14:59.798036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d0cf94d6-c98e-43b2-945a-97349e54cb0a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1274 microversion: 2.1 time: 0.127366 Aug 25 05:14:59.799171 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 133/265] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:14:59 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:00.097069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:00.097069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:00.104028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:00.104510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:00.105085 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:00.106249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:00.106698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:00.107121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:00.244938 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:00.246526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:00.253285 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:00.254780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:00.255472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:00.265021 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:00.265566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:00.266061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:00.426643 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:00.436787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-928d7be6-b546-4950-80f7-40027d8ef240 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.348764 Aug 25 05:15:00.442621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 133/266] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:00 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:00.463790 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:00.489268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d31dbaf6-eb07-455f-a986-ef5c0dffebb0 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.235311 Aug 25 05:15:00.490239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 134/267] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:00 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:00.819047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:00.819650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:00.826476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:00.826954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:00.827386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:00.828074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:00.828519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:00.828934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:00.974975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:00.983812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9d4fd79c-eb6f-42a3-9cf5-be653d33929f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.168528 Aug 25 05:15:00.984559 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 134/268] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:00 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:01.458975 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:01.459666 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:01.467019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:01.467583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:01.468110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:01.469029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:01.469941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:01.470577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:01.496710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:01.498154 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:01.504978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:01.505734 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:01.506472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:01.507488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:01.507938 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:01.508510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:01.629538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:01.643274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8a1f1404-3166-4c96-93a5-8e888b3dcb5d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.188199 Aug 25 05:15:01.644029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 135/269] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:01 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:01.755095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:01.763676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a8d8176c-0beb-4c6b-980f-1982d277aced tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.270818 Aug 25 05:15:01.773917 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 135/270] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:01 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:01.865878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-dd92aa53-4dac-4f23-b9c5-3bd58621d443 req-653d493f-a677-4dfe-875d-d4d894001dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae73d1d-6d07-4eae-8bff-4e95fa1b525d", "tag": "93471c85-b610-4fef-93f6-7b89d7e9a4e5"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:01.877678 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-dd92aa53-4dac-4f23-b9c5-3bd58621d443 req-653d493f-a677-4dfe-875d-d4d894001dd1 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:01.883912 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-dd92aa53-4dac-4f23-b9c5-3bd58621d443 req-653d493f-a677-4dfe-875d-d4d894001dd1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:01.883912 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-dd92aa53-4dac-4f23-b9c5-3bd58621d443 req-653d493f-a677-4dfe-875d-d4d894001dd1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:01.893005 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-dd92aa53-4dac-4f23-b9c5-3bd58621d443 req-653d493f-a677-4dfe-875d-d4d894001dd1 service nova] Creating event network-changed:93471c85-b610-4fef-93f6-7b89d7e9a4e5 for instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d on hv-cinder-85391 Aug 25 05:15:01.898845 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-dd92aa53-4dac-4f23-b9c5-3bd58621d443 req-653d493f-a677-4dfe-875d-d4d894001dd1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036896 Aug 25 05:15:01.899506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 136/271] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:15:02.004284 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:02.004882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:02.010956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:02.011920 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:02.012524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:02.013372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:02.014012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:02.015095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:02.226935 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:02.234836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-56c1d17f-8bd1-4d01-ba52-e26dbbadf51c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.234505 Aug 25 05:15:02.235398 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 136/272] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:01 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:02.665364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:02.666089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:02.672776 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:02.673270 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:02.673714 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:02.674395 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:02.674841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:02.675311 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:02.785237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:02.786484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:02.792637 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:02.793110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:02.793535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:02.794240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:02.794681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:02.795158 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:02.890041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:02.898858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8a02a94f-709e-449b-bfe4-d365e0b59b3c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.238103 Aug 25 05:15:02.899412 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 137/273] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:02 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:03.235816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:03.243983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3e6adf10-db25-47fc-af86-3e8a990a2562 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.462810 Aug 25 05:15:03.244557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 137/274] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:02 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:03.255935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:03.256908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:03.263519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:03.263998 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:03.264425 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:03.265107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:03.265549 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:03.265992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:03.400286 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:03.409474 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-682e88e0-4bcf-4273-b519-3016e69230c7 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.157360 Aug 25 05:15:03.410081 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 138/275] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:03 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:03.919763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:03.920357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:03.927063 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:03.927535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:03.927958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:03.928631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:03.929119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:03.929478 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:04.057095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:04.068048 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8bd3945f-3e4d-466f-98b1-b8ee00f62977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.148848 Aug 25 05:15:04.068048 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 138/276] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:03 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:04.264783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:04.265420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:04.272104 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:04.272573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:04.272999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:04.273704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:04.274149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:04.274640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:04.402726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:04.410824 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a1b3fe18-d002-4af0-9c21-cde5e544ffc8 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.150440 Aug 25 05:15:04.411376 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 139/277] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:04 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:04.430615 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:04.431174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:04.437483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:04.437994 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:04.438413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:04.439080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:04.439520 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:04.439928 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:04.571500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:04.579725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-32c5fa16-2b10-4833-925f-daa7950f89e3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.152828 Aug 25 05:15:04.580308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 139/278] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:04 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:05.086620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:05.087225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:05.094002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:05.094477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:05.094952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:05.095965 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:05.096610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:05.097256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:05.231620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:05.239392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7d9d3d8e-d90b-44eb-a509-a10e1eb1e299 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.156671 Aug 25 05:15:05.240081 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 140/279] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:05 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:05.431180 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:05.431782 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:05.433765 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:05.434453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=8 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:05.439086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:05.439550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:05.439970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:05.440644 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:05.441129 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:05.441544 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:05.567404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:05.576477 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b3d77129-87af-47e2-adbc-45995ec16509 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.149246 Aug 25 05:15:05.577039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 140/280] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:05 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:05.600093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:05.600695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:05.606999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:05.607455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:05.607895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:05.608551 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:05.608995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:05.609398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:05.624190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:05.753638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:05.761630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8f16efa6-555b-47b4-aec4-8c4c1bce98f3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.164829 Aug 25 05:15:05.762214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 141/281] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:05 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:06.260838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:06.261440 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:06.267730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:06.268196 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:06.268617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:06.269338 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:06.269801 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:06.270213 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:06.396250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:06.404028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-831c63c6-41b2-4d64-b015-4baf0c18dc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.147710 Aug 25 05:15:06.405072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 141/282] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:06 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:06.599078 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:06.599798 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:06.601995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:06.608639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:06.609109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:06.609538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:06.610243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:06.610712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:06.611278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:06.746709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:06.755483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-57dfe0c7-3395-4d01-88e6-aa8e6c46e014 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1554 microversion: 2.1 time: 0.161213 Aug 25 05:15:06.756278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 142/283] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:06 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:06.782267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:06.782861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:06.788532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:06.789006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:06.789442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:06.790312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:06.790753 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:06.791164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:06.993348 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:07.002283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c41857fa-55fd-44bf-825f-97930a0cae7d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.223790 Aug 25 05:15:07.008647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 142/284] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:06 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:07.326351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-9ecc0913-7823-45ad-bb22-59807b8157d7 req-ba72e7c2-fff9-4def-bbf8-1ac39454030e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c2d215-3277-4afa-a9af-3cb413c08b66", "name": "network-vif-deleted", "tag": "49238283-70cb-4e19-9e70-188976abe7d3"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:07.336419 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-9ecc0913-7823-45ad-bb22-59807b8157d7 req-ba72e7c2-fff9-4def-bbf8-1ac39454030e service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:07.336990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-9ecc0913-7823-45ad-bb22-59807b8157d7 req-ba72e7c2-fff9-4def-bbf8-1ac39454030e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:07.337468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-9ecc0913-7823-45ad-bb22-59807b8157d7 req-ba72e7c2-fff9-4def-bbf8-1ac39454030e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:07.349408 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-9ecc0913-7823-45ad-bb22-59807b8157d7 req-ba72e7c2-fff9-4def-bbf8-1ac39454030e service nova] Creating event network-vif-deleted:49238283-70cb-4e19-9e70-188976abe7d3 for instance 28c2d215-3277-4afa-a9af-3cb413c08b66 on hv-cinder-85391 Aug 25 05:15:07.355466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-9ecc0913-7823-45ad-bb22-59807b8157d7 req-ba72e7c2-fff9-4def-bbf8-1ac39454030e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034574 Aug 25 05:15:07.356355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 143/285] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:15:07.424778 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:07.425455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:07.432066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:07.432587 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:07.433546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:07.434259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:07.434704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:07.435117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:07.566068 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:07.574481 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bf711689-eb19-43ad-a471-bb22eb9df275 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.153043 Aug 25 05:15:07.575057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 143/286] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:07 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:07.777406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:07.778224 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:07.784391 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:07.787803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:07.787803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:07.787803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:07.787803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:07.788182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:07.852766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:07.861568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d64ada57-f84e-4c49-b863-dc9b8ffc63a6 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1512 microversion: 2.1 time: 0.089501 Aug 25 05:15:07.862164 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 144/287] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:07 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:08.023867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:08.024418 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:08.030275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:08.030743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:08.034002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:08.034002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:08.034002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:08.034002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:08.160547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:08.168890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-935bd1b8-05c2-4582-a632-c63ee54f4a9f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.148952 Aug 25 05:15:08.169540 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 144/288] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:08 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:08.596070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:08.596674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:08.602657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:08.603130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:08.603555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:08.604260 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:08.604799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:08.605137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:08.734299 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:08.742034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-29efd979-c996-4f64-9050-8ea07be7adbc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.149804 Aug 25 05:15:08.742597 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 145/289] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:08 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:08.882240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:08.882854 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:08.889500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:08.890006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:08.890511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:08.891202 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:08.891648 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:08.892140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:08.954701 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:08.963229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c6ae034c-a3de-4e13-8529-8935f4b5ece2 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1512 microversion: 2.1 time: 0.084981 Aug 25 05:15:08.969698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 145/290] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:08 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:09.189192 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:09.189847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:09.196390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:09.196858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:09.197422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:09.198128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:09.199125 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:09.199558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:09.221492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-f421ddb1-440e-47ce-8284-16292b27e661 req-2a5384e8-d78e-49b0-bdd4-3218b1a7063a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae73d1d-6d07-4eae-8bff-4e95fa1b525d", "name": "network-vif-plugged", "status": "completed", "tag": "93471c85-b610-4fef-93f6-7b89d7e9a4e5"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:09.239336 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-f421ddb1-440e-47ce-8284-16292b27e661 req-2a5384e8-d78e-49b0-bdd4-3218b1a7063a service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:09.239840 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-f421ddb1-440e-47ce-8284-16292b27e661 req-2a5384e8-d78e-49b0-bdd4-3218b1a7063a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:09.240245 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-f421ddb1-440e-47ce-8284-16292b27e661 req-2a5384e8-d78e-49b0-bdd4-3218b1a7063a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:09.253699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-f421ddb1-440e-47ce-8284-16292b27e661 req-2a5384e8-d78e-49b0-bdd4-3218b1a7063a service nova] Creating event network-vif-plugged:93471c85-b610-4fef-93f6-7b89d7e9a4e5 for instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d on hv-cinder-85391 Aug 25 05:15:09.258892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-f421ddb1-440e-47ce-8284-16292b27e661 req-2a5384e8-d78e-49b0-bdd4-3218b1a7063a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042864 Aug 25 05:15:09.259518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 146/291] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:15:09.473284 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:09.481068 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f5bfc568-67db-42b2-8f80-bfe18690204c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.295817 Aug 25 05:15:09.481736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 146/292] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:09 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:09.764111 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:09.764791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:09.771021 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:09.771490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:09.771908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:09.772590 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:09.773011 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:09.773422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:09.787790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:09.904918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:09.914485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f0fbd498-d123-4044-8339-ae2a3ddd94f4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.155408 Aug 25 05:15:09.916233 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 147/293] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:09 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:09.985564 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:09.986258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:09.992557 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:09.996717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:09.996717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:09.996717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:09.996717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:09.997080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:10.026820 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:10.027287 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:10.027711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:10.028159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lazy-loading 'fault' on Instance uuid 28c2d215-3277-4afa-a9af-3cb413c08b66 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:15:10.078366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:10.086489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-109a0b3c-65f7-47e5-aa0b-ee025f9cd892 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1351 microversion: 2.1 time: 0.105543 Aug 25 05:15:10.087067 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 147/294] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:09 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:10.500867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:10.501472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:10.507568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:10.508091 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:10.508518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:10.509202 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:10.509684 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:10.510105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:10.644121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:10.655961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-91206d4d-7e0f-436f-9998-a0f1194703be tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.158777 Aug 25 05:15:10.656621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 148/295] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:10 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:10.935562 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:10.936346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:10.942472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:10.942947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:10.943375 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:10.944080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:10.944608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:10.944946 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:11.086492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:11.094656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-37e213ae-902f-4997-b0d1-0398022ae28f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1520 microversion: 2.1 time: 0.163037 Aug 25 05:15:11.095215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 148/296] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:10 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:11.106911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:11.107515 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:11.113507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:11.114019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:11.114447 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:11.115145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:11.115597 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:11.116019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:11.283967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:11.284449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:11.284876 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:11.285317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lazy-loading 'fault' on Instance uuid 28c2d215-3277-4afa-a9af-3cb413c08b66 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:15:11.335536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3107aef7eb954ac4845c8903b005ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1f4463eb245468984f4747372d53fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:11.344810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cccf6b6c-11ef-48b4-b891-3538837fc064 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 200 len: 1351 microversion: 2.1 time: 0.241890 Aug 25 05:15:11.345514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 149/297] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:11 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 1351 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:11.676279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:11.677024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:11.683367 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:11.683848 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:11.684612 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:11.684943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:11.685433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:11.685826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:11.874433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:11.882396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3d319b4a-3d11-4fde-a04e-049a5bd767cc tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.209928 Aug 25 05:15:11.883025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 149/298] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:11 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:12.115441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:12.116132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:12.122590 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.123069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.123497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.124243 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.124694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.125144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.254035 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:12.261781 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-85096d08-40d0-44eb-b0a4-d72e3bd83567 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1500 microversion: 2.1 time: 0.150141 Aug 25 05:15:12.262340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 150/299] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:12 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1500 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:12.287920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:12.288534 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:12.295393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.295862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.296287 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.296959 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.297691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.297883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.366636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:12.366636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:12.374313 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.374987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.375409 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.376105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.376530 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.376941 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.391441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] HTTP exception thrown: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Request method failure captured: Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 HTTP/1.1 Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwT6e8b6FJulrI1ER66NcLJu5Y-Dw491gWK9jQJUqBk7pwKJ5aYjOkX6zS9TfDP4y7RqlcH_9d2rtDeUKjaaHyh4-kUnTsdR97RWj4GLoUPu1GkXSqCRoA4zk5xrF6K7xlyfbrMsZdmVk4GHUkhU_zbbilY16b5Vu_xDnobdLlJj6rc Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:12.396062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1f4463eb245468984f4747372d53fc6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 3107aef7eb954ac4845c8903b005ce93 Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.397320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '28c2d215-3277-4afa-a9af-3cb413c08b66'} Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:12.398095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.399446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.400426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Returning 404 to user: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:12.400426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-db53ec25-682e-4d08-9751-c4924b609b26 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 404 len: 111 microversion: 2.1 time: 0.035608 Aug 25 05:15:12.401066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 151/300] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:12 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:15:12.446408 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:12.461558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-05ec4713-a452-4b9c-b297-70118d9f9641 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1516 microversion: 2.1 time: 0.170264 Aug 25 05:15:12.461558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 150/301] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:12 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:12.524036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:12.526479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:12.532576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.533045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.533470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.534179 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.534640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.535049 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.549558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] HTTP exception thrown: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Request method failure captured: Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66/os-volume_attachments HTTP/1.1 Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwT6e8b6FJulrI1ER66NcLJu5Y-Dw491gWK9jQJUqBk7pwKJ5aYjOkX6zS9TfDP4y7RqlcH_9d2rtDeUKjaaHyh4-kUnTsdR97RWj4GLoUPu1GkXSqCRoA4zk5xrF6K7xlyfbrMsZdmVk4GHUkhU_zbbilY16b5Vu_xDnobdLlJj6rc Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:12.551382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1f4463eb245468984f4747372d53fc6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 3107aef7eb954ac4845c8903b005ce93 Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.552825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'server_id': '28c2d215-3277-4afa-a9af-3cb413c08b66'} Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:12.553642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:12.554951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:12.556222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Returning 404 to user: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:12.556222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5dddd84b-ce9f-4667-b724-a3f8245beb59 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032665 Aug 25 05:15:12.556222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 152/302] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:15:12 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:15:12.904183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:12.904802 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:12.910657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.911189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.911622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:12.912303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:12.912752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:12.913169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:13.059140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:13.085249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-adf04449-2cd0-43df-bb43-9bb6ef61ea2c tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1314 microversion: 2.1 time: 0.173266 Aug 25 05:15:13.085249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 151/303] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:12 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:14.095269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:14.095874 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:14.102066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:14.103573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:14.103573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:14.103814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:14.104032 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:14.104444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:14.240209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:14.247927 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ff371d52-a870-4edd-b122-65654398b9bb tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1499 microversion: 2.1 time: 0.156687 Aug 25 05:15:14.248490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 153/304] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:14 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1499 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:14.350097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:14.350596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:14.357910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:14.358397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:14.358834 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:14.359542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:14.359995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:14.360418 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:14.376486 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] HTTP exception thrown: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Request method failure captured: Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 HTTP/1.1 Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwT6e8b6FJulrI1ER66NcLJu5Y-Dw491gWK9jQJUqBk7pwKJ5aYjOkX6zS9TfDP4y7RqlcH_9d2rtDeUKjaaHyh4-kUnTsdR97RWj4GLoUPu1GkXSqCRoA4zk5xrF6K7xlyfbrMsZdmVk4GHUkhU_zbbilY16b5Vu_xDnobdLlJj6rc Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:15:14.381372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1f4463eb245468984f4747372d53fc6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 3107aef7eb954ac4845c8903b005ce93 Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.382930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '28c2d215-3277-4afa-a9af-3cb413c08b66'} Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:14.383713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.385004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.386315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Returning 404 to user: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:14.386315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7463549f-4580-4744-b94d-ef3bb3058463 tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 404 len: 111 microversion: 2.1 time: 0.036625 Aug 25 05:15:14.386315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 152/305] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:15:14 2022] DELETE /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:15:14.391484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:14.392092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] [instance: 28c2d215-3277-4afa-a9af-3cb413c08b66] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:14.398044 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:14.407137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:14.407137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:14.407137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:14.407137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:14.407607 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:14.414006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] HTTP exception thrown: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Request method failure captured: Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 HTTP/1.1 Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwT6e8b6FJulrI1ER66NcLJu5Y-Dw491gWK9jQJUqBk7pwKJ5aYjOkX6zS9TfDP4y7RqlcH_9d2rtDeUKjaaHyh4-kUnTsdR97RWj4GLoUPu1GkXSqCRoA4zk5xrF6K7xlyfbrMsZdmVk4GHUkhU_zbbilY16b5Vu_xDnobdLlJj6rc Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:14.415512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e1f4463eb245468984f4747372d53fc6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e1f4463eb245468984f4747372d53fc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: e1f4463eb245468984f4747372d53fc6 Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-DeleteServersTestJSON-246240855 Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 3107aef7eb954ac4845c8903b005ce93 Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-DeleteServersTestJSON-246240855-project Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.416944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '28c2d215-3277-4afa-a9af-3cb413c08b66'} Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:14.418330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. Aug 25 05:15:14.419669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:14.420821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] Returning 404 to user: Instance 28c2d215-3277-4afa-a9af-3cb413c08b66 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:14.420821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a32bad43-055e-41ed-b803-2a693ea2f41d tempest-DeleteServersTestJSON-246240855 tempest-DeleteServersTestJSON-246240855-project] 10.222.0.16 "GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66" status: 404 len: 111 microversion: 2.1 time: 0.029255 Aug 25 05:15:14.420821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 154/306] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:14 2022] GET /compute/v2.1/servers/28c2d215-3277-4afa-a9af-3cb413c08b66 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:15:15.630901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:15.633208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:15.641211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:15.652205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:15.652205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:15.652205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:15.652205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:15.653377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:15.673211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lazy-loading 'flavor' on Instance uuid da3a8721-5c5c-411a-85f9-8ee33510ccb6 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:15:16.059633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-511874f5-df5a-481a-a5cf-7edec85c3f1a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6/action" status: 200 len: 32 microversion: 2.1 time: 0.432780 Aug 25 05:15:16.060604 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 153/307] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:15:15 2022] POST /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:15:16.070768 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:16.071843 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:16.075520 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:16.079223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:16.079789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:16.080289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:16.081393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:16.081951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:16.082594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:16.200505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:16.201356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:16.207640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:16.208129 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:16.208558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:16.209430 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:16.209925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:16.210343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:16.239304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:15:16.318148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:16.328513 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d77be1e5-4244-4427-9358-5f51022c70c7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.262644 Aug 25 05:15:16.329080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 155/308] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:16 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:16.586409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a98f0460-f9ff-481d-a42f-1d749d21a965 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 204 len: 0 microversion: 2.1 time: 0.389843 Aug 25 05:15:16.591590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 154/309] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:15:16 2022] DELETE /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:15:16.597444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:16.598989 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:16.605057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:16.606050 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:16.606881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:16.608198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:16.608872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:16.609562 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:16.790235 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:16.798465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3ef5c204-2583-4409-b21d-3f41bcbcaf0e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1505 microversion: 2.1 time: 0.205548 Aug 25 05:15:16.800543 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 156/310] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:16 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:17.350316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:17.350944 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:17.358105 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:17.358589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:17.359017 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:17.359726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:17.360158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:17.360573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:17.376746 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:17.502370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:17.508086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a74c3f7d-77be-4241-9061-40e1428baa47 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.161990 Aug 25 05:15:17.508651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 155/311] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:17 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:17.821444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:17.822945 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:17.838694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:17.839234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:17.839676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:17.840727 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:17.846104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:17.846594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:18.017331 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:18.026967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a6e3ae6c-5e03-4382-81a0-34bce93f2eb3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1505 microversion: 2.1 time: 0.209278 Aug 25 05:15:18.026967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 157/312] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:17 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:18.531414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:18.532061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:18.539279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:18.539783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:18.540207 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:18.540886 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:18.541325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:18.541763 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:18.708470 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:18.717826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8de32a49-7ef6-43dc-9c4d-12eaed1ada2f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.191045 Aug 25 05:15:18.718397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 156/313] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:18 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:19.046446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:19.047040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:19.052977 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:19.053455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:19.053882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:19.054552 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:19.054998 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:19.063104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:19.183165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:19.190978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f069ef4a-24df-47ff-86b1-f6cd65e5d7b2 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1505 microversion: 2.1 time: 0.148549 Aug 25 05:15:19.191472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 158/314] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:19 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:19.740459 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:19.741089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:19.748966 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:19.749445 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:19.749896 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:19.750706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:19.751001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:19.751418 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:19.890098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:19.898779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-78667e0f-e62e-43c6-b5d2-7b90848f731d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.163072 Aug 25 05:15:19.899345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 157/315] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:19 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:20.211667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:20.212326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:20.219826 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:20.220470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:20.220912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:20.221728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:20.222251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:20.222742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:20.352196 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:20.360738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b30583bd-137b-4cf6-88c9-3cd466c7260f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1505 microversion: 2.1 time: 0.152916 Aug 25 05:15:20.361391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 159/316] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:20 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:20.564728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-15c4951c-ce97-46de-994e-caad9c815fff tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Action: 'create', calling method: .version_select at 0x7f2423d7e280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-458587496", "metadata": {"Type": "work"}}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-15c4951c-ce97-46de-994e-caad9c815fff tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Request method failure captured: Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 121 Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwVovUwcUyX1Bb-NJdeCY9NII0UghkfvVGKeunV0xLOldWKtLEXhMqfcmJrFxfF9PDZBCmHyCRIHAhA76SkoRpUJ3VG-7DR51VcyBDAbOJH_mDPDS4H-WX_6SOuKnOxYoq54uwo3Vw2XNFOwuzj3lQu5-8RYzGxPghgPO77lv-yigaA Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:15:20.574667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4987f6cd050f445b8912b388ab4e9221", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 268d55d57a864981a40baf4cacf182b5 Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-458587496", "metadata": {"Type": "work"}}} Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: Aug 25 05:15:20.576047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-458587496', 'metadata': {'Type': 'work'}}}} Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise error Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi '#$%' Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:20.576923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 05:15:20.578467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 05:15:20.579674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 05:15:20.579674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.579674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-15c4951c-ce97-46de-994e-caad9c815fff tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:20.579674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-15c4951c-ce97-46de-994e-caad9c815fff tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.124523 Aug 25 05:15:20.579674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 158/317] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Aug 25 05:15:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:15:20.585573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-78e6443b-6a97-40a0-b23b-7bdc8e2e3d14 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Action: 'create', calling method: .version_select at 0x7f2423d5f790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1163519365", "metadata": {"Type": "work"}}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-78e6443b-6a97-40a0-b23b-7bdc8e2e3d14 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Request method failure captured: Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 120 Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwVovUwcUyX1Bb-NJdeCY9NII0UghkfvVGKeunV0xLOldWKtLEXhMqfcmJrFxfF9PDZBCmHyCRIHAhA76SkoRpUJ3VG-7DR51VcyBDAbOJH_mDPDS4H-WX_6SOuKnOxYoq54uwo3Vw2XNFOwuzj3lQu5-8RYzGxPghgPO77lv-yigaA Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:20.591015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4987f6cd050f445b8912b388ab4e9221", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 268d55d57a864981a40baf4cacf182b5 Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1163519365", "metadata": {"Type": "work"}}} Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: Aug 25 05:15:20.592357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1163519365', 'metadata': {'Type': 'work'}}}} Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise error Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi '0' Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:20.593198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 05:15:20.594631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 05:15:20.595857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 05:15:20.595857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.595857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-78e6443b-6a97-40a0-b23b-7bdc8e2e3d14 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:20.595857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-78e6443b-6a97-40a0-b23b-7bdc8e2e3d14 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010607 Aug 25 05:15:20.595857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 160/318] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Aug 25 05:15:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:15:20.601075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1a4d291a-3329-4171-a49c-388a10759b45 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Action: 'create', calling method: .version_select at 0x7f2423ec9160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-134465567", "metadata": {"Type": "work"}}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1a4d291a-3329-4171-a49c-388a10759b45 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Request method failure captured: Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 118 Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwVovUwcUyX1Bb-NJdeCY9NII0UghkfvVGKeunV0xLOldWKtLEXhMqfcmJrFxfF9PDZBCmHyCRIHAhA76SkoRpUJ3VG-7DR51VcyBDAbOJH_mDPDS4H-WX_6SOuKnOxYoq54uwo3Vw2XNFOwuzj3lQu5-8RYzGxPghgPO77lv-yigaA Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:15:20.604548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4987f6cd050f445b8912b388ab4e9221", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 268d55d57a864981a40baf4cacf182b5 Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-134465567", "metadata": {"Type": "work"}}} Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: Aug 25 05:15:20.605931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-134465567', 'metadata': {'Type': 'work'}}}} Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise error Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi '' Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:20.606728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 05:15:20.607862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 05:15:20.608856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 05:15:20.608856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.608856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1a4d291a-3329-4171-a49c-388a10759b45 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:20.608856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1a4d291a-3329-4171-a49c-388a10759b45 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008528 Aug 25 05:15:20.608856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 159/319] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Aug 25 05:15:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:15:20.614467 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cb397984-ed7e-48b7-b6f3-b4bbdeef4a8a tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Calling method '.version_select at 0x7f2423d025e0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:20.642059 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-cb397984-ed7e-48b7-b6f3-b4bbdeef4a8a tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] HTTP exception thrown: Volume tempest-invalid-2044128221 could not be found. Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cb397984-ed7e-48b7-b6f3-b4bbdeef4a8a tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Request method failure captured: Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2044128221 HTTP/1.1 Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwVovUwcUyX1Bb-NJdeCY9NII0UghkfvVGKeunV0xLOldWKtLEXhMqfcmJrFxfF9PDZBCmHyCRIHAhA76SkoRpUJ3VG-7DR51VcyBDAbOJH_mDPDS4H-WX_6SOuKnOxYoq54uwo3Vw2XNFOwuzj3lQu5-8RYzGxPghgPO77lv-yigaA Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:20.644983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4987f6cd050f445b8912b388ab4e9221", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 268d55d57a864981a40baf4cacf182b5 Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Volume tempest-invalid-2044128221 could not be found. Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': 'tempest-invalid-2044128221'} Aug 25 05:15:20.646359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2044128221 could not be found. (HTTP 404) (Request-ID: req-f489dbec-2d9b-486a-965a-8065e2676582) Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.647190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 05:15:20.648417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2044128221 could not be found. Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:20.649532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2044128221 could not be found. Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2044128221 could not be found. Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cb397984-ed7e-48b7-b6f3-b4bbdeef4a8a tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Returning 404 to user: Volume tempest-invalid-2044128221 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cb397984-ed7e-48b7-b6f3-b4bbdeef4a8a tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2044128221" status: 404 len: 99 microversion: 2.1 time: 0.035644 Aug 25 05:15:20.650710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 161/320] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Aug 25 05:15:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2044128221 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 05:15:20.657426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5c1672e0-842c-4a92-ae26-852f3a9d3198 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003672 Aug 25 05:15:20.657945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 160/321] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Aug 25 05:15:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 05:15:20.666086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-350b35a7-3004-41d2-abfc-8b501e3967aa tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003613 Aug 25 05:15:20.666576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 162/322] 10.222.0.16 () {58 vars in 1137 bytes} [Thu Aug 25 05:15:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 25 05:15:20.674745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a63df0a9-d478-462f-8fa8-f0668040b87e tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Calling method '.version_select at 0x7f2423ec9550>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:20.702734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-a63df0a9-d478-462f-8fa8-f0668040b87e tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] HTTP exception thrown: Volume 001bca5a-fa49-4b0b-9be7-4ccf660fb407 could not be found. Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a63df0a9-d478-462f-8fa8-f0668040b87e tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Request method failure captured: Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/os-volumes/001bca5a-fa49-4b0b-9be7-4ccf660fb407 HTTP/1.1 Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwVovUwcUyX1Bb-NJdeCY9NII0UghkfvVGKeunV0xLOldWKtLEXhMqfcmJrFxfF9PDZBCmHyCRIHAhA76SkoRpUJ3VG-7DR51VcyBDAbOJH_mDPDS4H-WX_6SOuKnOxYoq54uwo3Vw2XNFOwuzj3lQu5-8RYzGxPghgPO77lv-yigaA Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:15:20.706326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4987f6cd050f445b8912b388ab4e9221", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 268d55d57a864981a40baf4cacf182b5 Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Volume 001bca5a-fa49-4b0b-9be7-4ccf660fb407 could not be found. Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '001bca5a-fa49-4b0b-9be7-4ccf660fb407'} Aug 25 05:15:20.710461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 001bca5a-fa49-4b0b-9be7-4ccf660fb407 could not be found. (HTTP 404) (Request-ID: req-9f1b7d1c-f4bc-434e-ae42-c91cfa5cf3be) Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.711340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 05:15:20.712366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 001bca5a-fa49-4b0b-9be7-4ccf660fb407 could not be found. Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 05:15:20.713717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 001bca5a-fa49-4b0b-9be7-4ccf660fb407 could not be found. Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 001bca5a-fa49-4b0b-9be7-4ccf660fb407 could not be found. Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a63df0a9-d478-462f-8fa8-f0668040b87e tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Returning 404 to user: Volume 001bca5a-fa49-4b0b-9be7-4ccf660fb407 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a63df0a9-d478-462f-8fa8-f0668040b87e tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/001bca5a-fa49-4b0b-9be7-4ccf660fb407" status: 404 len: 109 microversion: 2.1 time: 0.036413 Aug 25 05:15:20.715745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 161/323] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:15:20 2022] DELETE /compute/v2.1/os-volumes/001bca5a-fa49-4b0b-9be7-4ccf660fb407 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:15:20.718948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e8e0e2bf-0241-4926-8a54-5515273edd68 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Calling method '.version_select at 0x7f2423e099d0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:20.745664 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-e8e0e2bf-0241-4926-8a54-5515273edd68 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] HTTP exception thrown: Volume 41fdabae-5c96-434d-a251-32373c9bb4ad could not be found. Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e8e0e2bf-0241-4926-8a54-5515273edd68 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Request method failure captured: Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/os-volumes/41fdabae-5c96-434d-a251-32373c9bb4ad HTTP/1.1 Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwVovUwcUyX1Bb-NJdeCY9NII0UghkfvVGKeunV0xLOldWKtLEXhMqfcmJrFxfF9PDZBCmHyCRIHAhA76SkoRpUJ3VG-7DR51VcyBDAbOJH_mDPDS4H-WX_6SOuKnOxYoq54uwo3Vw2XNFOwuzj3lQu5-8RYzGxPghgPO77lv-yigaA Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:20.747654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4987f6cd050f445b8912b388ab4e9221", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4987f6cd050f445b8912b388ab4e9221"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 4987f6cd050f445b8912b388ab4e9221 Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesNegativeTest-1786635473 Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 268d55d57a864981a40baf4cacf182b5 Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesNegativeTest-1786635473-project Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Volume 41fdabae-5c96-434d-a251-32373c9bb4ad could not be found. Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '41fdabae-5c96-434d-a251-32373c9bb4ad'} Aug 25 05:15:20.749047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41fdabae-5c96-434d-a251-32373c9bb4ad could not be found. (HTTP 404) (Request-ID: req-d5cd3ebf-fd5b-467c-bf21-660599cdea25) Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.749948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:15:20.751144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41fdabae-5c96-434d-a251-32373c9bb4ad could not be found. Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 05:15:20.752268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41fdabae-5c96-434d-a251-32373c9bb4ad could not be found. Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41fdabae-5c96-434d-a251-32373c9bb4ad could not be found. Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e8e0e2bf-0241-4926-8a54-5515273edd68 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] Returning 404 to user: Volume 41fdabae-5c96-434d-a251-32373c9bb4ad could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e8e0e2bf-0241-4926-8a54-5515273edd68 tempest-VolumesNegativeTest-1786635473 tempest-VolumesNegativeTest-1786635473-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/41fdabae-5c96-434d-a251-32373c9bb4ad" status: 404 len: 109 microversion: 2.1 time: 0.034672 Aug 25 05:15:20.753283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 163/324] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:15:20 2022] GET /compute/v2.1/os-volumes/41fdabae-5c96-434d-a251-32373c9bb4ad => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:15:20.920486 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:20.921085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:20.923652 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:20.928555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:20.929035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:20.929462 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:20.930195 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:20.930690 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:20.931110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:21.057787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:21.065377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-722caa88-0aa6-43e7-98c3-d2768816f70a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.149774 Aug 25 05:15:21.066155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 162/325] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:20 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:21.381827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:21.383277 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:21.391638 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:21.392376 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:21.392811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:21.393790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:21.394378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:21.395128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:21.590541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:21.599053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d34a74b1-e579-4fba-8b6b-092a82905601 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1505 microversion: 2.1 time: 0.221426 Aug 25 05:15:21.599623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 164/326] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:21 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:22.109397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:22.109397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:22.109397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:22.109397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:22.110109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:22.110109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:22.110109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:22.110109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:22.233792 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:22.242049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5d3ead1d-2525-469d-aeff-14329db94b92 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.159549 Aug 25 05:15:22.242706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 163/327] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:22 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:22.620443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:22.621122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:22.627390 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:22.627871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:22.628299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:22.629048 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:22.629524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:22.629970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:22.838573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:22.850807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c7be45f3-48b0-4580-98d7-8d8fed1e198d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1505 microversion: 2.1 time: 0.234225 Aug 25 05:15:22.852066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 165/328] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:22 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:23.067728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-3a1f0a35-ee26-460a-91ec-21af566ebea4 req-5191db63-89dc-4083-9ebd-65574c09cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae73d1d-6d07-4eae-8bff-4e95fa1b525d", "name": "network-vif-deleted", "tag": "93471c85-b610-4fef-93f6-7b89d7e9a4e5"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:23.077090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-3a1f0a35-ee26-460a-91ec-21af566ebea4 req-5191db63-89dc-4083-9ebd-65574c09cd92 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:23.077537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-3a1f0a35-ee26-460a-91ec-21af566ebea4 req-5191db63-89dc-4083-9ebd-65574c09cd92 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:23.077999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-3a1f0a35-ee26-460a-91ec-21af566ebea4 req-5191db63-89dc-4083-9ebd-65574c09cd92 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:23.088995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-3a1f0a35-ee26-460a-91ec-21af566ebea4 req-5191db63-89dc-4083-9ebd-65574c09cd92 service nova] Creating event network-vif-deleted:93471c85-b610-4fef-93f6-7b89d7e9a4e5 for instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d on hv-cinder-85391 Aug 25 05:15:23.094199 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-3a1f0a35-ee26-460a-91ec-21af566ebea4 req-5191db63-89dc-4083-9ebd-65574c09cd92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031152 Aug 25 05:15:23.094827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 164/329] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:15:23.273807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:23.274278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:23.285385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:23.286017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:23.286449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:23.287163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:23.287624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:23.288688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:23.476825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:23.494846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-99e7d6f5-0d26-4513-a955-a32de3c782ce tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.226391 Aug 25 05:15:23.496537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 166/330] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:23 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:23.873750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:23.873750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:23.879032 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:23.879554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:23.879977 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:23.880666 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:23.881109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:23.881521 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:23.911765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:23.912233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:23.912657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:23.913098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lazy-loading 'fault' on Instance uuid 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:15:24.169000 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:24.176655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fe1f25ca-9dea-4b1c-bfca-0e9778bd5f6f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 200 len: 1304 microversion: 2.1 time: 0.308969 Aug 25 05:15:24.177208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 165/331] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:23 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 1304 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:24.516776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:24.517375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:24.524308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:24.524775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:24.525199 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:24.532829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:24.532829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:24.532829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:24.659505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:24.667324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-abc72e53-fe9e-4043-b491-ec5c1fd6405e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.154422 Aug 25 05:15:24.667891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 167/332] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:24 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:25.196727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:25.197332 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:25.204266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:25.204761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:25.205197 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:25.205911 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:25.206357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:25.211245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:25.220162 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] HTTP exception thrown: Instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d could not be found. Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Request method failure captured: Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d HTTP/1.1 Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwVHA2oH0fxTve82OQpeuXhuewPdjJYs-ut4mh8q-h8ExLZAZIsNd5UD9E0GZj9437h5GWcJQcDECIwnDYEJ15ytNAKHr7suYIusnZc_mY6EW9py3qwsQnbL0ZuM332KzV6iK8md_-VsSpNw5gmEa_ZW3Kj0crK6i8gcYsa6kFDqIsk Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: a252c620742a4f6b9fdaafb4cb81f10f Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-VolumesActionsTest-1317825884 Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:15:25.221840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252c620742a4f6b9fdaafb4cb81f10f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a252c620742a4f6b9fdaafb4cb81f10f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a252c620742a4f6b9fdaafb4cb81f10f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252c620742a4f6b9fdaafb4cb81f10f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-VolumesActionsTest-1317825884 Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: a252c620742a4f6b9fdaafb4cb81f10f Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-VolumesActionsTest-1317825884 Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-VolumesActionsTest-1317825884-project Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 5be22eb85b3b4828a36edc6e1fcc05f7 Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-VolumesActionsTest-1317825884-project Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d could not be found. Aug 25 05:15:25.223290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '4ae73d1d-6d07-4eae-8bff-4e95fa1b525d'} Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d could not be found. Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:25.224054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d could not be found. Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d could not be found. Aug 25 05:15:25.225090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:15:25.226576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Returning 404 to user: Instance 4ae73d1d-6d07-4eae-8bff-4e95fa1b525d could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:25.226576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ed5ec3a2-1b9d-4f90-9e0e-c137235f0d15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d" status: 404 len: 111 microversion: 2.1 time: 0.030406 Aug 25 05:15:25.226576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 166/333] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:25 2022] GET /compute/v2.1/servers/4ae73d1d-6d07-4eae-8bff-4e95fa1b525d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:15:25.327475 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1208057935", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "networks": [{"uuid": "9e3c45bf-ee3e-4ac8-a35e-7c209d55d11f"}]}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:25.389135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] validate_networks() for [('9e3c45bf-ee3e-4ac8-a35e-7c209d55d11f', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:15:25.697784 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:25.699020 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:25.705010 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:25.706172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:25.706172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:25.706741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:25.707183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:25.707593 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:25.744428 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:15:25.745028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:15:25.745283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:15:25.745707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:15:25.746102 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:15:25.754968 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:25.755435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:25.755857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:25.756568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:25.757008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:25.757455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:25.774357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Getting quotas for project a252c620742a4f6b9fdaafb4cb81f10f. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:15:25.778381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Getting quotas for user 5be22eb85b3b4828a36edc6e1fcc05f7 and project a252c620742a4f6b9fdaafb4cb81f10f. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:15:25.789225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:15:25.791526 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:15:25.839388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:25.847458 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-908ff9f9-ea16-47b3-9625-372be3ef1a4a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.156021 Aug 25 05:15:25.848020 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 167/334] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:25 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:25.976919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-97dc7cec-8a7f-4f87-b74b-b9e6c7770281 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653324 Aug 25 05:15:25.983181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 168/335] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:15:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:15:25.988880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-675998db-d2ee-4fcb-8b4a-16b22fa8dcf4 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:25.989560 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-675998db-d2ee-4fcb-8b4a-16b22fa8dcf4 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:26.047385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-675998db-d2ee-4fcb-8b4a-16b22fa8dcf4 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:26.058853 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-675998db-d2ee-4fcb-8b4a-16b22fa8dcf4 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1214 microversion: 2.1 time: 0.073687 Aug 25 05:15:26.059428 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 168/336] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:25 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:26.868829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:26.869502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:26.875568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:26.876096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:26.876526 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:26.877213 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:26.877690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:26.878112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:27.009706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:27.017442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1bc516e7-688c-47a8-860e-3ee8f4ea3178 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.152529 Aug 25 05:15:27.018032 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 169/337] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:26 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:27.079665 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:27.080645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:27.087169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:27.087730 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:27.088225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:27.089431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:27.089984 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:27.090784 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:27.155641 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:27.163333 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-31fe11e2-2b2e-4e69-ba12-3afb18acc5d0 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1218 microversion: 2.1 time: 0.087846 Aug 25 05:15:27.163887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 169/338] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:27 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:28.038637 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:28.039298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:28.045867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:28.046368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:28.046817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:28.047528 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:28.047969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:28.048384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:28.064055 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:28.179692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:28.186128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:28.192085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:28.192198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5882493e-3f81-4b98-94e4-a82204733622 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.153470 Aug 25 05:15:28.192198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 170/339] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:28 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:28.193129 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:28.193616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:28.194053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:28.194733 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:28.195270 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:28.195688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:28.257538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:28.265095 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3738a6f8-a448-4884-ab1a-b4658e4d0353 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1266 microversion: 2.1 time: 0.084590 Aug 25 05:15:28.265680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 170/340] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:28 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:29.209457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:29.210260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:29.216757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:29.217271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:29.217722 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:29.218412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:29.219326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:29.219326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:29.285903 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:29.287224 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:29.295981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:29.296876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:29.297751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:29.298932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:29.299414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:29.299830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:29.389990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:29.398642 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7dc2970b-87aa-497d-b810-45e4a7f47a4a tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1272 microversion: 2.1 time: 0.116327 Aug 25 05:15:29.399806 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 171/341] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:29 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:29.452914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:29.461302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5fa88ecd-609a-49eb-bab8-9dc005d4f11d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.255670 Aug 25 05:15:29.462001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 171/342] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:29 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:30.424432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:30.425397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:30.431840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:30.432317 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:30.432779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:30.433473 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:30.433953 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:30.434370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:30.490317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:30.491695 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:30.505706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:30.512775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:30.512775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:30.512775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:30.512775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:30.513335 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:30.574721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:30.582475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7819cd59-54bc-49e3-b4be-a7f011920d65 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.162059 Aug 25 05:15:30.583024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 172/343] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:30 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:30.616112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-6cbe4276-b05f-4c70-9318-f5354d353945 req-4874983f-977d-4349-ac88-6d113134b145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203c2b53-7c5a-47a3-856f-12068777e837", "tag": "91ccd576-94b3-4218-a7f7-374fb45a2640"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:30.626323 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6cbe4276-b05f-4c70-9318-f5354d353945 req-4874983f-977d-4349-ac88-6d113134b145 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:30.628043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6cbe4276-b05f-4c70-9318-f5354d353945 req-4874983f-977d-4349-ac88-6d113134b145 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:30.628043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6cbe4276-b05f-4c70-9318-f5354d353945 req-4874983f-977d-4349-ac88-6d113134b145 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:30.638879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-6cbe4276-b05f-4c70-9318-f5354d353945 req-4874983f-977d-4349-ac88-6d113134b145 service nova] Creating event network-changed:91ccd576-94b3-4218-a7f7-374fb45a2640 for instance 203c2b53-7c5a-47a3-856f-12068777e837 on hv-cinder-85391 Aug 25 05:15:30.643699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-6cbe4276-b05f-4c70-9318-f5354d353945 req-4874983f-977d-4349-ac88-6d113134b145 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032290 Aug 25 05:15:30.644301 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 173/344] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:15:30.699508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:30.707883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d98c1d37-e2c5-442c-9771-a2e221f6ca61 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.223437 Aug 25 05:15:30.708489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 172/345] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:30 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:31.604614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:31.605235 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:31.612146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:31.612698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:31.613163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:31.613950 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:31.614452 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:31.614910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:31.728576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:31.729187 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:31.736199 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:31.736678 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:31.737100 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:31.737969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:31.738435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:31.738847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:31.755160 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:31.762757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c2bc48a9-298f-4633-929b-8054890f5663 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.163158 Aug 25 05:15:31.763321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 174/346] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:31 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:31.870877 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:31.878588 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3bf9cda3-4da4-47e7-8390-0981c754c927 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.154008 Aug 25 05:15:31.879145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 173/347] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:31 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:32.784519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:32.785042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:32.791596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:32.792193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:32.792633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:32.793343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:32.793826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:32.794246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:32.900205 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:32.901364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:32.909577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:32.910323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:32.910801 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:32.911569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:32.912022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:32.912456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:32.922632 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:32.930188 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0a4fe027-8002-4139-87a5-138c35ef299e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.150471 Aug 25 05:15:32.930765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 175/348] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:32 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:33.039078 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:33.046765 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b04f128f-e0c1-4d01-b835-8f5526353d29 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.150654 Aug 25 05:15:33.047325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 174/349] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:32 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:33.953156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:33.953784 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:33.960181 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:33.960649 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:33.961075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:33.961782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:33.962223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:33.962636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:34.067830 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:34.068426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:34.074404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:34.074885 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:34.075315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:34.075994 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:34.076437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:34.076852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:34.092116 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:34.099749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e4b420f6-92ca-4182-bb0c-29e746e3e8a1 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.151248 Aug 25 05:15:34.100395 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 176/350] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:33 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:34.203738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:34.212398 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d54bfe68-d7f4-491e-b9cf-e5b7fed8ab4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.148049 Aug 25 05:15:34.212964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 175/351] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:34 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:35.120960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:35.121602 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:35.127932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:35.128419 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:35.128881 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:35.129553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:35.130087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:35.130539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:35.234658 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:35.235533 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:35.241924 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:35.242519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:35.243015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:35.243722 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:35.244314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:35.244736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:35.260640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:35.268911 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c18a01d3-3c79-4dfa-bfef-991968182de5 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.151715 Aug 25 05:15:35.269502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 177/352] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:35 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:35.375905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:35.383646 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8bb72ebf-e741-4448-8f84-dc736349a0ad tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.154170 Aug 25 05:15:35.384252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 176/353] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:35 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:36.289624 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:36.290226 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:36.292681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:36.297890 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:36.298368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:36.298797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:36.299478 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:36.299922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:36.300335 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:36.404584 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:36.405310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:36.407183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:36.407870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=6 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:36.412633 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:36.413112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:36.413537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:36.414239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:36.414687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:36.415100 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:36.435849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:36.438019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=100 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:36.444630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-567dec4d-9cef-45ec-843d-c2008fcd6c8e tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.158093 Aug 25 05:15:36.444630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 178/354] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:36 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:36.609163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:36.617077 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d8acb098-2588-4bfb-bbc5-876cf90e7e21 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.216367 Aug 25 05:15:36.617663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 177/355] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:36 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:37.466012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:37.466694 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:37.473067 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:37.473538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:37.474038 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:37.474673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:37.475115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:37.475564 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:37.602123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:37.610650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cf9a372f-3bf3-4ef8-a7e9-7a67e5a4d7c3 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.150056 Aug 25 05:15:37.612087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 179/356] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:37 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:37.637923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:37.640572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:37.644887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:37.645379 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:37.645838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:37.646540 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:37.646988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:37.647405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:37.785089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:37.794434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d1e7cc57-9556-407e-8484-700845cdadcf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.160321 Aug 25 05:15:37.801234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 178/357] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:37 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:38.630729 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:38.631363 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:38.638268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:38.638743 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:38.639172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:38.639852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:38.640298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:38.640806 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:38.774833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:38.784069 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a8df51c5-be7a-43fd-8844-1b7b85c9ddaf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.157051 Aug 25 05:15:38.784899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 180/358] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:38 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:38.823630 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:38.823630 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:38.826663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:38.827136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:38.827573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:38.828252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:38.828692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:38.829150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:38.962349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:38.972838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b81b3bda-3535-4152-8c09-88515e144d95 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.155357 Aug 25 05:15:38.972838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 179/359] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:38 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:39.804462 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:39.805122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:39.811832 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:39.814581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:39.814581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:39.814581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:39.814581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:39.815024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:39.950307 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:39.957948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-676fd6d6-02fb-4f75-8a34-b94991fe6612 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.157492 Aug 25 05:15:39.958513 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 181/360] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:39 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:39.992172 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:39.992804 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:39.998823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:39.999292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:39.999716 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:40.000476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:40.000933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:40.001350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:40.132755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:40.141981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9df0f163-b0f9-43a9-b14f-5403feaf77ee tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.153437 Aug 25 05:15:40.143150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 180/361] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:39 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:40.978983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:40.980092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:40.986542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:40.987022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:40.987451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:40.988138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:40.988589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:40.989008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:41.124653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:41.132486 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6bae6626-632d-47f6-a8e7-9d4110c0494f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.157439 Aug 25 05:15:41.133052 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 182/362] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:40 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:41.163962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:41.164906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:41.171238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:41.171709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:41.172130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:41.172811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:41.173282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:41.173814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:41.311071 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:41.318774 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8588c8c2-4a75-4928-89ca-f470cac8dda7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.158873 Aug 25 05:15:41.321871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 181/363] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:41 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:42.153237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:42.153992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:42.160375 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:42.160843 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:42.161465 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:42.162156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:42.162601 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:42.163019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:42.296085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:42.303704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-277182f7-4837-4a6d-be48-2170549b5732 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.154795 Aug 25 05:15:42.304277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 183/364] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:42 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:42.339248 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:42.339847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:42.347444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:42.348342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:42.348776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:42.349706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:42.350163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:42.350709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:42.482188 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:42.489948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3128da4b-f684-4ced-996d-cfd6db32dee0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.155224 Aug 25 05:15:42.490511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 182/365] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:42 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:42.768834 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-f24c3ecb-47aa-4446-9cfd-9a843ea03c26 req-49fccfb1-3c22-43da-af01-c96ab4a90570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203c2b53-7c5a-47a3-856f-12068777e837", "name": "network-vif-plugged", "status": "completed", "tag": "91ccd576-94b3-4218-a7f7-374fb45a2640"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:42.778845 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f24c3ecb-47aa-4446-9cfd-9a843ea03c26 req-49fccfb1-3c22-43da-af01-c96ab4a90570 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:42.780688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f24c3ecb-47aa-4446-9cfd-9a843ea03c26 req-49fccfb1-3c22-43da-af01-c96ab4a90570 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:42.780688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f24c3ecb-47aa-4446-9cfd-9a843ea03c26 req-49fccfb1-3c22-43da-af01-c96ab4a90570 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:42.790312 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-f24c3ecb-47aa-4446-9cfd-9a843ea03c26 req-49fccfb1-3c22-43da-af01-c96ab4a90570 service nova] Creating event network-vif-plugged:91ccd576-94b3-4218-a7f7-374fb45a2640 for instance 203c2b53-7c5a-47a3-856f-12068777e837 on hv-cinder-85391 Aug 25 05:15:42.795722 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-f24c3ecb-47aa-4446-9cfd-9a843ea03c26 req-49fccfb1-3c22-43da-af01-c96ab4a90570 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030588 Aug 25 05:15:42.796285 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 184/366] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:15:43.327018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:43.327018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:43.330966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:43.331433 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:43.331856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:43.332531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:43.332970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:43.333382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:43.472425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:43.480742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c53aaf51-dbca-4960-aa75-70e2ff8d85cf tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.160429 Aug 25 05:15:43.481298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 183/367] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:43 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:43.511487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:43.512525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:43.518445 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:43.518924 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:43.519397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:43.520084 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:43.520540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:43.520960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:43.652477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:43.660235 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f4445ad5-b9ff-47f7-b735-b162764e6df1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.153629 Aug 25 05:15:43.660800 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 185/368] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:43 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:44.501310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:44.501941 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:44.507849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:44.508347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:44.508771 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:44.509449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:44.509915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:44.513234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:44.641525 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:44.649652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b3dd7878-536d-4f77-b787-64bb16afab8b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.152071 Aug 25 05:15:44.650216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 184/369] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:44 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:44.680781 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:44.681402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:44.688057 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:44.688618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:44.689062 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:44.689771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:44.690245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:44.690657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:44.820793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:44.829179 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a2d81d94-01ec-4758-a003-bd05fd31b138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.152341 Aug 25 05:15:44.829813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 186/370] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:44 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:45.671594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:45.672212 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:45.678165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:45.678637 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:45.679080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:45.679738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:45.680182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:45.680598 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:45.807702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:45.815283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0f72da38-e9f4-4b35-953e-df459e18c086 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1314 microversion: 2.1 time: 0.147527 Aug 25 05:15:45.815844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 185/371] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:45 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:45.850057 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:45.850738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:45.857322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:45.857859 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:45.858296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:45.859144 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:45.859422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:45.859838 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:45.991778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:46.000052 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-311098bb-3544-4774-b514-3ba8d05f873a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1502 microversion: 2.1 time: 0.153887 Aug 25 05:15:46.000609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 187/372] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:45 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:46.020535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36ac44f5-0d2f-406a-b367-97d16102d917"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:46.023018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:46.028931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.029401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.029866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.030543 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.031036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.031456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.054499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] HTTP exception thrown: Cannot 'attach_volume' instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 while it is in vm_state rescued Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Request method failure captured: Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: POST /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6/os-volume_attachments HTTP/1.1 Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 74 Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUEnS3WKZ3AMTaTAOcloCHy3PDXGF5w46c4H_iBcA-z_zhXtqDR6hSX7ZnL03cySTyZg3pAWCLD2hcxzf-BHGb-up0NemC2sgcVWY1NNUxRtuBAwSupdG7m9UnVDWMyak1g2q_DpFMc7s7q93NeFrioU3j36FQWgTXGdm33A_jwA18 Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:46.056067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8afac3f36b8449aa8a25a376aa2c3ed9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: b6ca9962541744bf9d67cc3e05721413 Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {"volumeAttachment": {"volumeId": "36ac44f5-0d2f-406a-b367-97d16102d917"}} Aug 25 05:15:46.057971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Cannot 'attach_volume' instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 while it is in vm_state rescued Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'server_id': 'da3a8721-5c5c-411a-85f9-8ee33510ccb6', 'body': {'volumeAttachment': {'volumeId': '36ac44f5-0d2f-406a-b367-97d16102d917'}}} Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:46.059037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 while it is in vm_state rescued Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:46.060377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:46.061677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:46.061677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:46.061677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 while it is in vm_state rescued Aug 25 05:15:46.061677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:46.061677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Returning 409 to user: Cannot 'attach_volume' instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 while it is in vm_state rescued {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:46.061677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-68697e33-6dfe-4637-b551-3d2413b03cf4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040980 Aug 25 05:15:46.061677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 186/373] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:15:46 2022] POST /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 05:15:46.067356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:46.067924 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:46.073799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.074278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.074706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.075471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.075910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.076327 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.395013 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-53a80ce6-be48-445b-96f0-72fced75ffed tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6/action" status: 202 len: 0 microversion: 2.1 time: 0.331395 Aug 25 05:15:46.398610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 188/374] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:15:46 2022] POST /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:15:46.405263 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:46.405914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:46.407762 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:46.412595 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.413064 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.413487 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.414324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.414764 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.415173 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.431547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:46.551106 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:46.558683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7ca36f00-7e28-4839-a660-f67a3755570d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1510 microversion: 2.1 time: 0.158253 Aug 25 05:15:46.559250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 187/375] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:46 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:46.836925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:46.838096 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:46.845033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.845514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.846028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.846712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:46.847152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:46.847563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:46.985344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:46.993611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-40f534f4-697e-4f17-82cc-c770e22cc977 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1498 microversion: 2.1 time: 0.160950 Aug 25 05:15:46.994297 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 189/376] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:46 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:47.580209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:47.580845 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:47.587707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:47.588184 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:47.588612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:47.589349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:47.589829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:47.590247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:47.722897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:47.729838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5d0bc779-8e4e-4a8c-a9fe-463d682baf25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1510 microversion: 2.1 time: 0.153819 Aug 25 05:15:47.730398 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 188/377] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:47 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:47.961197 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:47.961711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:47.968837 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:47.969437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:47.969901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:47.970580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:47.971019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:47.971431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:47.996372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:15:48.288913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-254b7622-bb08-46f7-9052-229418a3330f tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "DELETE /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 204 len: 0 microversion: 2.1 time: 0.331501 Aug 25 05:15:48.289512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 190/378] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:15:47 2022] DELETE /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:15:48.297951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:48.298552 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:48.304389 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:48.304861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:48.305281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:48.306603 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:48.307096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:48.307511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:48.435238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:48.442902 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b768dadd-db8d-4954-8ded-1e9b45910c1b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1504 microversion: 2.1 time: 0.149005 Aug 25 05:15:48.443462 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 189/379] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:48 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:15:48.751487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:48.752112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:48.760328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:48.760328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:48.760328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:48.760328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:48.760826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:48.760826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:48.891829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:48.899641 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a2c60ab9-08e6-4e07-8c89-56d44cb65988 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1510 microversion: 2.1 time: 0.152484 Aug 25 05:15:48.900243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 191/380] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:48 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:49.465113 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:49.466001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:49.471916 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:49.473556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:49.473556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:49.473556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:49.473911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:49.474321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:49.602681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:49.610399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6da4908a-1378-42d2-8a96-5316a7ae104b tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1504 microversion: 2.1 time: 0.149625 Aug 25 05:15:49.610970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 190/381] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:49 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:49.920825 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:49.921482 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:49.927903 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:49.928381 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:49.928807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:49.929488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:49.929960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:49.930387 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:50.055900 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:50.064002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d9ad0149-89d2-4fc1-9bdd-2411b6a4f9ab tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1510 microversion: 2.1 time: 0.147039 Aug 25 05:15:50.064565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 192/382] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:49 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:50.631636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:50.632238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:50.638844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:50.639347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:50.639770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:50.640445 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:50.640887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:50.641297 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:50.768912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:50.776548 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8168ec67-9877-4b06-ac35-1b843f2fcf15 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1504 microversion: 2.1 time: 0.148725 Aug 25 05:15:50.777115 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 191/383] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:50 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:51.085344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:51.086147 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:51.093337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:51.093849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:51.094281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:51.094958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:51.095402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:51.095816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:51.110837 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:51.230898 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:51.238698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-66b1f590-413f-4aec-8ced-dd327c9e05dc tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1510 microversion: 2.1 time: 0.157196 Aug 25 05:15:51.239253 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 193/384] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:51 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:51.796682 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:51.797269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:51.803258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:51.803728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:51.804149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:51.804822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:51.805409 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:51.805843 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:51.937502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:51.945426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-56c62e4a-0b57-4de8-94f3-c8b413a42099 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1504 microversion: 2.1 time: 0.152713 Aug 25 05:15:51.946028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 192/385] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:51 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:52.259400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:52.260006 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:52.262600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:15:52.267446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:52.267918 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:52.268348 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:52.269024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:52.269465 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:52.269915 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:52.396676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:52.404346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-dd8cf19d-bdc3-4f33-95c2-3694baf0b9ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1516 microversion: 2.1 time: 0.148793 Aug 25 05:15:52.404902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 194/386] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:52 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:52.967232 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:52.967839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:52.973868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:52.979105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:52.979105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:52.979105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:52.979105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:52.979461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:53.206267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:53.215026 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a40fec99-6850-43a2-8355-56470f7a6a6d tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1504 microversion: 2.1 time: 0.252435 Aug 25 05:15:53.216128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 193/387] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:52 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:53.646363 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-b76708e6-ac1b-44e0-a370-556d8c23c94b req-ca3493c1-9ea1-4754-9ff9-93a45b081e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203c2b53-7c5a-47a3-856f-12068777e837", "name": "network-vif-deleted", "tag": "91ccd576-94b3-4218-a7f7-374fb45a2640"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:53.655524 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b76708e6-ac1b-44e0-a370-556d8c23c94b req-ca3493c1-9ea1-4754-9ff9-93a45b081e1b service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:53.655994 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b76708e6-ac1b-44e0-a370-556d8c23c94b req-ca3493c1-9ea1-4754-9ff9-93a45b081e1b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:53.656414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b76708e6-ac1b-44e0-a370-556d8c23c94b req-ca3493c1-9ea1-4754-9ff9-93a45b081e1b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:53.668001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-b76708e6-ac1b-44e0-a370-556d8c23c94b req-ca3493c1-9ea1-4754-9ff9-93a45b081e1b service nova] Creating event network-vif-deleted:91ccd576-94b3-4218-a7f7-374fb45a2640 for instance 203c2b53-7c5a-47a3-856f-12068777e837 on hv-cinder-85391 Aug 25 05:15:53.672614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-b76708e6-ac1b-44e0-a370-556d8c23c94b req-ca3493c1-9ea1-4754-9ff9-93a45b081e1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030002 Aug 25 05:15:53.681252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 195/388] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:15:54.240402 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:54.241077 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:54.247619 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:54.248097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:54.248593 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:54.249282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:54.249751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:54.250169 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:54.280991 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:54.281537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:54.281988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:54.282423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lazy-loading 'fault' on Instance uuid 203c2b53-7c5a-47a3-856f-12068777e837 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:15:54.323769 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be22eb85b3b4828a36edc6e1fcc05f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a252c620742a4f6b9fdaafb4cb81f10f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:54.331343 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e86b9824-c8ab-45ee-b859-2e7b48865213 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 200 len: 1304 microversion: 2.1 time: 0.094884 Aug 25 05:15:54.331908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 194/389] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:54 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:55.202039 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-712cc311-f5e2-49be-82f1-a46730be201c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'create', calling method: .version_select at 0x7f2423e68790>, body: {"keypair": {"name": "tempest-keypair-1462648714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjAM6qLps7XuwJpRXh+psGxdh+6wH/wDSyD6yABqFhmOU7zPjSV9cCSi3EruP5rKVaT7RxM+z9AQitsZZzNVgaihATg+fMuRyruVE4XM5NfBwppqHlRlaUl210bP8z4Dw=="}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:55.217249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-712cc311-f5e2-49be-82f1-a46730be201c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:15:55.221212 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-712cc311-f5e2-49be-82f1-a46730be201c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for user b6ca9962541744bf9d67cc3e05721413 and project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:15:55.352328 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:55.352930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] [instance: 203c2b53-7c5a-47a3-856f-12068777e837] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:55.359635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:55.360112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:55.360538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:55.361215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:55.361681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:55.362095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:55.370414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-712cc311-f5e2-49be-82f1-a46730be201c tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173309 Aug 25 05:15:55.371200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 196/390] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:15:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:15:55.377396 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] HTTP exception thrown: Instance 203c2b53-7c5a-47a3-856f-12068777e837 could not be found. Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Request method failure captured: Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 HTTP/1.1 Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwVHA2oH0fxTve82OQpeuXhuewPdjJYs-ut4mh8q-h8ExLZAZIsNd5UD9E0GZj9437h5GWcJQcDECIwnDYEJ15ytNAKHr7suYIusnZc_mY6EW9py3qwsQnbL0ZuM332KzV6iK8md_-VsSpNw5gmEa_ZW3Kj0crK6i8gcYsa6kFDqIsk Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: a252c620742a4f6b9fdaafb4cb81f10f Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesActionsTest-1317825884 Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:15:55.378995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252c620742a4f6b9fdaafb4cb81f10f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a252c620742a4f6b9fdaafb4cb81f10f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a252c620742a4f6b9fdaafb4cb81f10f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a252c620742a4f6b9fdaafb4cb81f10f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesActionsTest-1317825884 Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: a252c620742a4f6b9fdaafb4cb81f10f Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesActionsTest-1317825884 Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesActionsTest-1317825884-project Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 5be22eb85b3b4828a36edc6e1fcc05f7 Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesActionsTest-1317825884-project Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 203c2b53-7c5a-47a3-856f-12068777e837 could not be found. Aug 25 05:15:55.382227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '203c2b53-7c5a-47a3-856f-12068777e837'} Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 203c2b53-7c5a-47a3-856f-12068777e837 could not be found. Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:15:55.383066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203c2b53-7c5a-47a3-856f-12068777e837 could not be found. Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203c2b53-7c5a-47a3-856f-12068777e837 could not be found. Aug 25 05:15:55.386542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:15:55.387545 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] Returning 404 to user: Instance 203c2b53-7c5a-47a3-856f-12068777e837 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:15:55.387545 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bc08ecb7-fdff-4aac-a615-e716d3cd5f99 tempest-VolumesActionsTest-1317825884 tempest-VolumesActionsTest-1317825884-project] 10.222.0.16 "GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837" status: 404 len: 111 microversion: 2.1 time: 0.031915 Aug 25 05:15:55.387545 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 195/391] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:55 2022] GET /compute/v2.1/servers/203c2b53-7c5a-47a3-856f-12068777e837 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:15:57.972644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-811132631", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0988213e-697f-43c0-8bbc-3d3f281f4405"}], "security_groups": [{"name": "tempest-securitygroup--820970538"}], "key_name": "tempest-keypair-1462648714", "user_data": "}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:15:58.079741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] validate_networks() for [('0988213e-697f-43c0-8bbc-3d3f281f4405', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:15:58.462854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:15:58.463316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:15:58.463783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:15:58.464185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:15:58.464669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:15:58.474000 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:58.474475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:58.474902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:58.475624 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:58.476106 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:58.476511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:58.495516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:15:58.499701 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Getting quotas for user b6ca9962541744bf9d67cc3e05721413 and project 8afac3f36b8449aa8a25a376aa2c3ed9. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:15:58.511371 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:15:58.513775 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:15:58.699582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c5bf8167-cf42-4214-9e4b-0ca0640ea236 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.731745 Aug 25 05:15:58.700294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 197/392] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:15:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:15:58.711015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-37d64cb5-2a36-44c2-98cf-01b1a51a630b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:58.711622 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-37d64cb5-2a36-44c2-98cf-01b1a51a630b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:58.781417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-37d64cb5-2a36-44c2-98cf-01b1a51a630b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:58.789497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-37d64cb5-2a36-44c2-98cf-01b1a51a630b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1245 microversion: 2.1 time: 0.082257 Aug 25 05:15:58.790698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 196/393] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:58 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:15:59.812129 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:15:59.812732 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:15:59.819377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:59.819847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:59.820272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:59.820952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:15:59.821392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:15:59.821879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:15:59.885709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:15:59.893347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a4c83f7c-f377-4757-871d-e96c08c62e71 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1249 microversion: 2.1 time: 0.086219 Aug 25 05:15:59.893951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 198/394] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:15:59 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:00.913390 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:00.914015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:00.919987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:00.920452 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:00.920871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:00.921542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:00.922006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:00.922416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:00.983268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:00.991186 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3ae77523-0d82-4894-82f7-83669fa0282b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1249 microversion: 2.1 time: 0.081553 Aug 25 05:16:00.991748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 197/395] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:00 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:02.012834 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:02.013398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:02.019824 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:02.020298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:02.020722 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:02.021401 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:02.021864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:02.022277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:02.085243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:02.093452 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-695a6d41-8a0d-4f37-9fe4-aefede58c766 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1241 microversion: 2.1 time: 0.085250 Aug 25 05:16:02.094047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 199/396] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:02 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:03.117661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:03.118264 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:03.124571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:03.125046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:03.126249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:03.126249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:03.126580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:03.126987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:03.195549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:03.209280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ff801958-18df-45af-a0d0-c334bd07e91a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1315 microversion: 2.1 time: 0.092366 Aug 25 05:16:03.210786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 198/397] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:03 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:04.234914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:04.235508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:04.246169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:04.247255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:04.254380 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:04.255341 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:04.255952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:04.256649 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:04.476903 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:04.494430 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9f5d8a08-e959-4078-8762-7b12850cf566 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.263071 Aug 25 05:16:04.508765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 200/398] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:04 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:05.519941 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:05.520716 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:05.526676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:05.527146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:05.527572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:05.528237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:05.528676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:05.529084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:05.654301 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:05.661967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3c32729f-ebdf-494d-8f27-e9276eeeb2ec tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.145978 Aug 25 05:16:05.662575 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 199/399] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:05 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:06.687499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:06.690071 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-aeb7143f-aba5-4c2f-a350-8db9b46a0e32 req-ae04b6b5-fecd-4654-b3e0-0df4d95d1509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79e79a1-46cc-437a-8c59-452ad20d1c13", "tag": "dec7654a-e3e6-4b89-9a04-fa7592ccc30b"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:16:06.692143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:06.708714 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:06.711693 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:06.713708 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:06.714772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:06.716862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:06.718094 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-aeb7143f-aba5-4c2f-a350-8db9b46a0e32 req-ae04b6b5-fecd-4654-b3e0-0df4d95d1509 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:06.718696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:06.721497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-aeb7143f-aba5-4c2f-a350-8db9b46a0e32 req-ae04b6b5-fecd-4654-b3e0-0df4d95d1509 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:06.722141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-aeb7143f-aba5-4c2f-a350-8db9b46a0e32 req-ae04b6b5-fecd-4654-b3e0-0df4d95d1509 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:06.759694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-aeb7143f-aba5-4c2f-a350-8db9b46a0e32 req-ae04b6b5-fecd-4654-b3e0-0df4d95d1509 service nova] Creating event network-changed:dec7654a-e3e6-4b89-9a04-fa7592ccc30b for instance e79e79a1-46cc-437a-8c59-452ad20d1c13 on hv-cinder-85391 Aug 25 05:16:06.766850 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-aeb7143f-aba5-4c2f-a350-8db9b46a0e32 req-ae04b6b5-fecd-4654-b3e0-0df4d95d1509 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084390 Aug 25 05:16:06.768584 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 200/400] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:16:06.897290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:06.909173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-09b920b6-3d97-45a6-9308-f7ded48c2d38 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.228030 Aug 25 05:16:06.927230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 201/401] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:06 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:16:07.947686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:07.949070 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:07.962677 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:07.963612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:07.964203 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:07.965359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:07.966015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:07.966829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:08.187787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:08.196874 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e8f01dbf-410e-4d3d-a96a-287224aa1d96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.260403 Aug 25 05:16:08.200881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 201/402] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:07 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:09.220467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:09.221073 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:09.223631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:09.224797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=10 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:09.230064 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:09.232598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:09.233067 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:09.233843 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:09.234461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:09.234968 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:09.364511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:09.372896 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fcf72930-08f7-49c3-87b3-d13658d07984 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.156605 Aug 25 05:16:09.376997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 202/403] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:09 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:10.396483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:10.397088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:10.400082 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:10.404237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:10.404715 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:10.409046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:10.409046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:10.409046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:10.409046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:10.538008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:10.546128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dc299720-2684-49ee-9355-173c1da17ff5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.153414 Aug 25 05:16:10.546688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 202/404] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:10 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:11.566577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:11.567164 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:11.574762 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:11.575235 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:11.575661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:11.576410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:11.576851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:11.577260 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:11.709084 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:11.718037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-47ed336d-0d87-4ba4-9c7c-0d6f54aee917 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.154773 Aug 25 05:16:11.718203 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 203/405] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:11 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:16:12.737442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:12.737995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:12.743910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:12.744897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:12.745323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:12.746041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:12.746486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:12.746901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:12.872387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:12.879828 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-653cf0b8-23a8-40ee-bf20-10cd6c799b17 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.146362 Aug 25 05:16:12.880395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 203/406] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:12 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:13.901288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:13.902623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:13.909699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:13.910587 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:13.911170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:13.911907 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:13.912344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:13.913037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:14.084722 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:14.099552 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7bedb63f-2f02-462b-a1b2-bdf8bd5d89df tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.202131 Aug 25 05:16:14.100362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 204/407] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:13 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:15.124183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:15.124949 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:15.131303 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:15.132044 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:15.132687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:15.133648 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:15.134316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:15.134803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:15.314218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:15.326411 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dd903fd9-7aee-4690-ac97-88029b4996ea tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.206032 Aug 25 05:16:15.327558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 204/408] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:15 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:16.348783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:16.350533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:16.372745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:16.375313 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:16.375807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:16.376542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:16.377024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:16.377399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:16.549512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:16.560837 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-aea5551c-1138-4c99-9bf4-b3c971ed7744 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.216779 Aug 25 05:16:16.574258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 205/409] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:16 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:17.581371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:17.584697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:17.591173 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:17.594370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:17.594370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:17.594370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:17.594370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:17.594798 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:17.596879 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=94 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:17.740797 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:17.748362 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0ec95f6d-1068-4abc-85e3-f6da882ebec4 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.171205 Aug 25 05:16:17.749021 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 205/410] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:17 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:18.468881 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-8279972d-f4e5-40ee-ad2f-ffa76269a392 req-810d1d29-3a5d-44cc-87c1-2ebfdab6e9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79e79a1-46cc-437a-8c59-452ad20d1c13", "name": "network-vif-plugged", "status": "completed", "tag": "dec7654a-e3e6-4b89-9a04-fa7592ccc30b"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:16:18.485550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8279972d-f4e5-40ee-ad2f-ffa76269a392 req-810d1d29-3a5d-44cc-87c1-2ebfdab6e9c3 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:18.486538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8279972d-f4e5-40ee-ad2f-ffa76269a392 req-810d1d29-3a5d-44cc-87c1-2ebfdab6e9c3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:18.488440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8279972d-f4e5-40ee-ad2f-ffa76269a392 req-810d1d29-3a5d-44cc-87c1-2ebfdab6e9c3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:18.503786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-8279972d-f4e5-40ee-ad2f-ffa76269a392 req-810d1d29-3a5d-44cc-87c1-2ebfdab6e9c3 service nova] Creating event network-vif-plugged:dec7654a-e3e6-4b89-9a04-fa7592ccc30b for instance e79e79a1-46cc-437a-8c59-452ad20d1c13 on hv-cinder-85391 Aug 25 05:16:18.522100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-8279972d-f4e5-40ee-ad2f-ffa76269a392 req-810d1d29-3a5d-44cc-87c1-2ebfdab6e9c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049182 Aug 25 05:16:18.522100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 206/411] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:16:18.769110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:18.769928 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:18.771604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=42 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:18.777060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:18.784939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:18.785706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:18.786601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:18.787207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:18.787634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:18.934638 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:18.943276 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d88a02b3-db66-48bc-80a8-bd5aeba2ef25 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.177484 Aug 25 05:16:18.957711 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 206/412] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:18 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:19.967643 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:19.968401 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:19.976392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:19.977184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:19.977746 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:19.978572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:19.979079 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:19.979559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:20.153419 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:20.163664 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-082ac65a-101e-40a2-a308-ef3e61279897 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.201357 Aug 25 05:16:20.165025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 207/413] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:19 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:21.186530 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:21.186530 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:21.196639 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:21.197124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:21.198213 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:21.198896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:21.199334 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:21.199914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:21.364610 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:21.376145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ce833e2a-261a-42c4-93e2-3627dae4abe5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1370 microversion: 2.1 time: 0.195799 Aug 25 05:16:21.376721 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 207/414] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:21 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:22.399140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:22.401152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:22.409876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:22.415396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:22.415396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:22.415396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:22.415396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:22.415768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:22.415768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:22.417869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=70 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:22.587808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:22.610638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-13b6d168-3a7f-420d-9fe8-eb5f30411165 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1563 microversion: 2.1 time: 0.217017 Aug 25 05:16:22.611624 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 208/415] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:22 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1563 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:22.631863 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:22.632415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:22.639589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:22.640159 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:22.640659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:22.641437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:22.641968 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:22.642469 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:22.727564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1d317cec-ed65-41c9-8b09-729d11afbd56 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099741 Aug 25 05:16:22.729971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 208/416] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:16:22 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:16:24.149950 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-4080f3b5-e326-4412-a66b-f024d94ca319 req-b5ed2b5c-e2a4-45f5-9710-fea3c9f9585a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79e79a1-46cc-437a-8c59-452ad20d1c13", "tag": "dec7654a-e3e6-4b89-9a04-fa7592ccc30b"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:16:24.160788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-4080f3b5-e326-4412-a66b-f024d94ca319 req-b5ed2b5c-e2a4-45f5-9710-fea3c9f9585a service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:24.161262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-4080f3b5-e326-4412-a66b-f024d94ca319 req-b5ed2b5c-e2a4-45f5-9710-fea3c9f9585a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:24.161745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-4080f3b5-e326-4412-a66b-f024d94ca319 req-b5ed2b5c-e2a4-45f5-9710-fea3c9f9585a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:24.173255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-4080f3b5-e326-4412-a66b-f024d94ca319 req-b5ed2b5c-e2a4-45f5-9710-fea3c9f9585a service nova] Creating event network-changed:dec7654a-e3e6-4b89-9a04-fa7592ccc30b for instance e79e79a1-46cc-437a-8c59-452ad20d1c13 on hv-cinder-85391 Aug 25 05:16:24.178913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-4080f3b5-e326-4412-a66b-f024d94ca319 req-b5ed2b5c-e2a4-45f5-9710-fea3c9f9585a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032539 Aug 25 05:16:24.179527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 209/417] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:16:24.770470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-15856368", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:16:24.838896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] validate_networks() for None {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:16:25.213709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:16:25.214336 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:16:25.215434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:16:25.215936 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:16:25.216403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:16:25.227019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:25.227862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:25.228543 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:25.229465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:25.230314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:25.230938 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:25.267619 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Getting quotas for project 1ba0701fef4648c8b434d92a5588afd9. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:16:25.271806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Getting quotas for user b9cb460463b44f89b391e145746190c0 and project 1ba0701fef4648c8b434d92a5588afd9. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:16:25.284169 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:16:25.286989 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:16:25.434543 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-165cd358-2a80-44f5-ba80-fdf9e04a0966 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671448 Aug 25 05:16:25.437524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 209/418] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:16:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:16:25.449743 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5b8d90b7-ce7e-44e3-b33e-d7231e6d19c0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:25.451390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5b8d90b7-ce7e-44e3-b33e-d7231e6d19c0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:25.546250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5b8d90b7-ce7e-44e3-b33e-d7231e6d19c0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:25.553500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5b8d90b7-ce7e-44e3-b33e-d7231e6d19c0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1213 microversion: 2.1 time: 0.108645 Aug 25 05:16:25.555357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 210/419] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:25 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:26.576508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cecf4da6-f3b9-4fc8-81b6-8e86c736be44 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:26.577060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cecf4da6-f3b9-4fc8-81b6-8e86c736be44 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:26.629195 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cecf4da6-f3b9-4fc8-81b6-8e86c736be44 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:26.636635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cecf4da6-f3b9-4fc8-81b6-8e86c736be44 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1213 microversion: 2.1 time: 0.064656 Aug 25 05:16:26.637181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 210/420] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:26 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:27.656293 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:27.656940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:27.664441 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:27.664907 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:27.665330 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:27.666032 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:27.666481 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:27.666890 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:27.728608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:27.736561 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-857aed99-dad3-4d5e-a071-f67e570f23be tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1217 microversion: 2.1 time: 0.084085 Aug 25 05:16:27.737120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 211/421] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:27 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:28.757520 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:28.758152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:28.765263 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:28.765860 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:28.766286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:28.766960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:28.767399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:28.767814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:28.825996 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:28.833504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-96d2ebbf-0c6f-4187-a699-d84b2384d6bd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1217 microversion: 2.1 time: 0.079867 Aug 25 05:16:28.834093 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 211/422] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:28 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:29.855167 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:29.855737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:29.862932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:29.863401 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:29.863829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:29.864506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:29.864948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:29.865388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:29.927172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:29.934725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-18a7d14b-a5dd-4857-9bac-9c95863b44e0 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1209 microversion: 2.1 time: 0.084086 Aug 25 05:16:29.935280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 212/423] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:29 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:30.955405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:30.956006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:30.961888 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:30.962364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:30.962790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:30.963480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:30.963914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:30.964331 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:31.029379 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:31.037096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-71da0d82-54ef-45bc-81bf-d78597ed8732 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1209 microversion: 2.1 time: 0.085582 Aug 25 05:16:31.037675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 212/424] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:30 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:32.058453 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:32.059060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:32.065780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:32.066262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:32.066695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:32.067383 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:32.067832 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:32.068251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:32.130846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:32.139018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5ce462a9-7d08-4b82-b5b7-6a48a158dc35 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1265 microversion: 2.1 time: 0.084959 Aug 25 05:16:32.147255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 213/425] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:32 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:33.159064 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:33.160235 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:33.167273 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:33.168484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:33.169945 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:33.171356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:33.172191 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:33.172749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:33.251282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:33.258981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2cc7790b-9174-4e1d-8bba-19b8934106cd tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1271 microversion: 2.1 time: 0.103723 Aug 25 05:16:33.259556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 213/426] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:33 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:34.280803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:34.281550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:34.288268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:34.288823 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:34.289321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:34.290381 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:34.290939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:34.291431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:34.486653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:34.495594 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-33fa56f1-25f7-41ef-a48b-3e4c6a4f01b8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.219650 Aug 25 05:16:34.496450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 214/427] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:34 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:34.775480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-7bce5a4e-f627-41a9-ad23-f8df3e7ce556 req-e6f2fcba-361f-47e4-8e18-fb2999b34d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c8fd6e-0f63-444a-bf22-4c585a97c5b9", "tag": "2a7a208e-a98f-418e-97a5-f7af5087235d"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:16:34.794399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7bce5a4e-f627-41a9-ad23-f8df3e7ce556 req-e6f2fcba-361f-47e4-8e18-fb2999b34d34 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:34.795811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7bce5a4e-f627-41a9-ad23-f8df3e7ce556 req-e6f2fcba-361f-47e4-8e18-fb2999b34d34 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:34.796425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7bce5a4e-f627-41a9-ad23-f8df3e7ce556 req-e6f2fcba-361f-47e4-8e18-fb2999b34d34 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:34.811804 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-7bce5a4e-f627-41a9-ad23-f8df3e7ce556 req-e6f2fcba-361f-47e4-8e18-fb2999b34d34 service nova] Creating event network-changed:2a7a208e-a98f-418e-97a5-f7af5087235d for instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 on hv-cinder-85391 Aug 25 05:16:34.817135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-7bce5a4e-f627-41a9-ad23-f8df3e7ce556 req-e6f2fcba-361f-47e4-8e18-fb2999b34d34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045321 Aug 25 05:16:34.818450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 214/428] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:16:35.516851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:35.517649 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:35.528484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:35.528484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:35.528484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:35.528484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:35.528864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:35.528864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:35.554313 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:35.673986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:35.683951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-73c9f611-f4ab-480e-9eee-a59de7c232a7 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.171011 Aug 25 05:16:35.684533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 215/429] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:35 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:36.701564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:36.702401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=8 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:36.706461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:36.707155 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:36.713912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:36.714394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:36.714862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:36.715542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:36.715985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:36.716399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:36.844827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:36.852335 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f0b228cb-af17-4926-8cc7-2f43082ae091 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.151680 Aug 25 05:16:36.852892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 215/430] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:36 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:37.873341 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:37.873968 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:37.880509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:37.880981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:37.881403 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:37.882118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:37.882563 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:37.882983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:38.016698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:38.024336 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-afe6b7f4-f082-49af-a470-ee050f522b4f tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.155204 Aug 25 05:16:38.024894 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 216/431] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:37 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:39.045428 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:39.052170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:39.052846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:39.053324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:39.053784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:39.054466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:39.054910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:39.055325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:39.185465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:39.193029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0c4ca8f3-1f7a-4192-86ab-7984ab4c59f3 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.152563 Aug 25 05:16:39.193615 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 216/432] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:39 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:40.215143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:40.215612 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:40.233059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:40.233548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:40.234003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:40.234726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:40.235176 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:40.235592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:40.392337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:40.402036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8ea67e45-e132-4bda-af1f-63e2744679c2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.191364 Aug 25 05:16:40.402696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 217/433] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:40 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:41.423743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:41.424374 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:41.430375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:41.430853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:41.431280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:41.431970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:41.432414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:41.432834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:41.567323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:41.574032 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c63cb2f6-1fc7-4fbf-b94a-bf8f33bec9a8 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.154316 Aug 25 05:16:41.574602 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 217/434] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:41 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:42.595406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:42.595993 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:42.602501 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:42.602987 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:42.603422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:42.604662 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:42.605117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:42.605541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:42.735031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:42.742661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4a1a5cf1-ee2f-4c9a-976a-53de2405fedc tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.151423 Aug 25 05:16:42.743257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 218/435] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:42 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:43.763673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:43.764365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:43.770395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:43.770908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:43.771325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:43.772006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:43.772441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:43.772851 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:43.912923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:43.921366 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-eb572a22-e6f7-46be-abc8-b457d63d0836 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.162037 Aug 25 05:16:43.935482 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 218/436] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:43 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:44.942378 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:44.942971 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:44.954867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:44.955283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:44.955726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:44.956407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:44.956848 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:44.957466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:45.103489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:45.111288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b95e1614-cac3-4670-92ee-c433342eeffb tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.172746 Aug 25 05:16:45.111859 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 219/437] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:44 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:46.133976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:46.134605 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:46.141250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:46.141699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:46.142121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:46.142789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:46.143266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:46.143671 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:46.277979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:46.285708 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cba4b5c8-5dcb-4a03-a615-40739f567c09 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.156129 Aug 25 05:16:46.286275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 219/438] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:46 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:46.958931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-ab0084a6-de8b-4eb2-b362-5693a1ee065d req-74589527-971a-4538-9e4c-bf8a19f6ca27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c8fd6e-0f63-444a-bf22-4c585a97c5b9", "name": "network-vif-plugged", "status": "completed", "tag": "2a7a208e-a98f-418e-97a5-f7af5087235d"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:16:46.976296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ab0084a6-de8b-4eb2-b362-5693a1ee065d req-74589527-971a-4538-9e4c-bf8a19f6ca27 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:46.976775 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ab0084a6-de8b-4eb2-b362-5693a1ee065d req-74589527-971a-4538-9e4c-bf8a19f6ca27 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:46.977204 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ab0084a6-de8b-4eb2-b362-5693a1ee065d req-74589527-971a-4538-9e4c-bf8a19f6ca27 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:46.988966 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-ab0084a6-de8b-4eb2-b362-5693a1ee065d req-74589527-971a-4538-9e4c-bf8a19f6ca27 service nova] Creating event network-vif-plugged:2a7a208e-a98f-418e-97a5-f7af5087235d for instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 on hv-cinder-85391 Aug 25 05:16:46.993880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-ab0084a6-de8b-4eb2-b362-5693a1ee065d req-74589527-971a-4538-9e4c-bf8a19f6ca27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038513 Aug 25 05:16:46.994509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 220/439] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:16:47.306040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:47.306644 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:47.313159 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:47.313681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:47.314118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:47.321417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:47.321417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:47.321417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:47.505998 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:47.515946 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0ed654ec-7314-4dcc-ae05-d50fff4d13b2 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.213566 Aug 25 05:16:47.516566 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:47 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:48.538025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:48.538676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:48.545359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:48.545857 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:48.546282 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:48.546953 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:48.547391 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:48.547799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:48.694318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:48.703229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9a0b2e27-c2da-4e69-bf01-d560993ecdd9 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.169982 Aug 25 05:16:48.703810 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 221/441] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:48 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:49.724329 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:49.724920 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:49.727197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:49.734420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:49.734420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:49.734420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:49.734420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:49.734860 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:49.735180 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:49.737955 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=80 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:49.879795 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:49.890882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8f7fc0f7-d5cb-4d7c-8c09-bd2bd546b169 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1313 microversion: 2.1 time: 0.167000 Aug 25 05:16:49.890882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 221/442] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:49 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:50.909539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:50.910196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:50.916773 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:50.917231 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:50.917671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:50.918352 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:50.918800 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:50.919841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:51.052284 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:51.060062 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-123aaae2-4cb3-49c5-aec8-0a6fbb463644 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1462 microversion: 2.1 time: 0.154317 Aug 25 05:16:51.060632 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 222/443] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:50 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1462 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:51.105700 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:51.106270 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:51.112545 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:51.113025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:51.113450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:51.114156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:51.114602 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:51.115017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:51.139804 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:16:51.432697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dac39988-1c56-420c-8cc6-a10089e27e00 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 204 len: 0 microversion: 2.1 time: 0.329792 Aug 25 05:16:51.433432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 222/444] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:16:51 2022] DELETE /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:16:51.441452 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:51.442095 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:51.448659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:51.449243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:51.449771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:51.450479 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:51.451013 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:51.451429 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:51.597123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:51.605225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ccd16196-e697-4bc2-a6e3-9287a19ed78a tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1468 microversion: 2.1 time: 0.167681 Aug 25 05:16:51.605821 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 223/445] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:51 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:52.626393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:52.627091 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:52.632978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:52.633453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:52.633923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:52.635107 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:52.635564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:52.635985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:52.770333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:52.778043 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a6f49b4e-41d0-4a5a-9814-e10b623fcbf6 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1468 microversion: 2.1 time: 0.155926 Aug 25 05:16:52.783550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 223/446] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:52 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:53.798927 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:53.799723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:53.806138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:53.806651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:53.807135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:53.807828 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:53.808273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:53.808688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:53.901992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:53.910292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-34e520d5-9c00-44e3-8b3e-83d458b015a4 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1426 microversion: 2.1 time: 0.115052 Aug 25 05:16:53.910871 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 224/447] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:53 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1426 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:53.937613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-ffad4917-a567-41ae-9049-5acfe483c117 req-2de8f8f8-e691-40ff-b009-8e1e9f1dca6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c8fd6e-0f63-444a-bf22-4c585a97c5b9", "name": "network-vif-deleted", "tag": "2a7a208e-a98f-418e-97a5-f7af5087235d"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:16:53.947552 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ffad4917-a567-41ae-9049-5acfe483c117 req-2de8f8f8-e691-40ff-b009-8e1e9f1dca6a service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:53.947933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ffad4917-a567-41ae-9049-5acfe483c117 req-2de8f8f8-e691-40ff-b009-8e1e9f1dca6a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:53.948361 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ffad4917-a567-41ae-9049-5acfe483c117 req-2de8f8f8-e691-40ff-b009-8e1e9f1dca6a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:53.959778 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-ffad4917-a567-41ae-9049-5acfe483c117 req-2de8f8f8-e691-40ff-b009-8e1e9f1dca6a service nova] Creating event network-vif-deleted:2a7a208e-a98f-418e-97a5-f7af5087235d for instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 on hv-cinder-85391 Aug 25 05:16:53.965267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-ffad4917-a567-41ae-9049-5acfe483c117 req-2de8f8f8-e691-40ff-b009-8e1e9f1dca6a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Aug 25 05:16:53.965903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 224/448] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:16:54.932158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:54.932772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:54.935925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=36 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:54.940793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:54.941273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:54.941733 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:54.942422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:54.942869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:54.943337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:54.945972 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=88 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:16:54.980101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:54.980574 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:54.981003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:54.981438 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lazy-loading 'fault' on Instance uuid 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:16:55.024586 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9cb460463b44f89b391e145746190c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba0701fef4648c8b434d92a5588afd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:16:55.032214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bd6f483d-e8d3-4d82-9971-c7f80a5a57ad tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 200 len: 1303 microversion: 2.1 time: 0.103877 Aug 25 05:16:55.032776 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 225/449] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:54 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:16:56.053468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:16:56.054128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] [instance: 70c8fd6e-0f63-444a-bf22-4c585a97c5b9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:16:56.061054 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:56.061524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:56.062633 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:56.062633 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:16:56.063087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:16:56.063500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:16:56.076259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] HTTP exception thrown: Instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 could not be found. Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Request method failure captured: Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 HTTP/1.1 Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwWlsyfl4_eBEYtFMqv6XpBuCmidJHal3IpO0F7FS15RDtgQ7gcQVEMQSXnAkx5dgPKTIOEIcCOBCWL8hZRAQAqKuKMZKai7M6s6bq529JZQFVjOUj9ZvJNc6UyHsBsAWclS64hhyWjBI6T8vIJATdj3Ghr1Brl1bdmyn4qzuui4Zb4 Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 1ba0701fef4648c8b434d92a5588afd9 Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesNegativeTest-1162275644 Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:16:56.077864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ba0701fef4648c8b434d92a5588afd9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ba0701fef4648c8b434d92a5588afd9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ba0701fef4648c8b434d92a5588afd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ba0701fef4648c8b434d92a5588afd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesNegativeTest-1162275644 Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 1ba0701fef4648c8b434d92a5588afd9 Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesNegativeTest-1162275644 Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesNegativeTest-1162275644-project Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: b9cb460463b44f89b391e145746190c0 Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesNegativeTest-1162275644-project Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 could not be found. Aug 25 05:16:56.079504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '70c8fd6e-0f63-444a-bf22-4c585a97c5b9'} Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 could not be found. Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:16:56.080378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 could not be found. Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 could not be found. Aug 25 05:16:56.081810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:16:56.083017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] Returning 404 to user: Instance 70c8fd6e-0f63-444a-bf22-4c585a97c5b9 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:16:56.083017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0864f976-64e9-414f-9304-057ce845e183 tempest-VolumesNegativeTest-1162275644 tempest-VolumesNegativeTest-1162275644-project] 10.222.0.16 "GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9" status: 404 len: 111 microversion: 2.1 time: 0.029855 Aug 25 05:16:56.083017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 225/450] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:16:56 2022] GET /compute/v2.1/servers/70c8fd6e-0f63-444a-bf22-4c585a97c5b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:17:01.439371 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:01.439861 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:01.446758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:01.447230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:01.447655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:01.448331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:01.450400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:01.450400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:01.471771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c73b10a9-a2f5-4c33-8204-6fbb2c188753 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/ips" status: 200 len: 152 microversion: 2.20 time: 0.036614 Aug 25 05:17:01.472328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 226/451] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Aug 25 05:17:01 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:17:04.861937 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:04.862525 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:04.868706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:04.869219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:04.869672 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:04.870367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:04.870819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:04.871248 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:04.895292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lazy-loading 'flavor' on Instance uuid 070a4cc0-c2a7-4e19-b265-7c540dc6f045 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:17:05.338634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:17:05.338817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Thu Aug 25 05:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/action (ip 10.222.0.16) !!! Aug 25 05:17:05.379164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5d43154a-67b8-48d3-a96c-4b6a2097602e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/action" status: 202 len: 0 microversion: 2.20 time: 0.521060 Aug 25 05:17:05.379755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 226/452] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Aug 25 05:17:04 2022] POST /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:17:05.387993 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:05.388599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:05.395610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:05.396092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:05.396519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:05.397213 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:05.397696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:05.398114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:05.527846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:05.536614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:05.538146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:05.539329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-02ad22b4-f56f-4d49-99cf-74a5de85ab37 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.155240 Aug 25 05:17:05.539881 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 227/453] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:05 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:06.563903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:06.564601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:06.571597 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:06.572070 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:06.572498 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:06.573181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:06.574100 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:06.574526 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:06.702685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:06.710937 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:06.712446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:06.713688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1aab18ad-8b5c-488a-b004-27fbe463a9e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.154710 Aug 25 05:17:06.714247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 227/454] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:06 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:06.823152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:06.823651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:06.830065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:06.830521 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:06.830947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:06.831629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:06.832073 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:06.832491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:06.858764 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2c1fc08f-e243-4e5f-bc6c-7923a5be2551 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/ips" status: 200 len: 149 microversion: 2.1 time: 0.039538 Aug 25 05:17:06.859330 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 228/455] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:17:06 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:07.736280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:07.736879 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:07.742846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:07.743347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:07.743767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:07.744439 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:07.744887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:07.745328 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:07.869443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:07.879412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:07.880910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:07.882084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f8c176d3-256b-44d4-81e5-32ac58b0a4ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.149678 Aug 25 05:17:07.882635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 228/456] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:07 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:08.909625 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:08.910887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:08.917357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:08.917874 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:08.918304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:08.919655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:08.920222 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:08.920650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:09.056237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:09.065108 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:09.066653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:09.067807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b413799b-b699-4222-af76-fbab55e46eac tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.166142 Aug 25 05:17:09.068415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 229/457] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:08 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:09.610610 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d45e3d13-03f7-450e-ada4-c4a2341c4a19"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:09.613422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:09.641228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:09.641228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:09.641228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:09.641228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:09.642147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:09.642147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:10.090850 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:10.091393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:10.098198 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:10.098672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:10.099099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:10.099774 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:10.100219 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:10.100634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:10.233796 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:10.241916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:10.243413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:10.244560 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-083d35e6-31bf-4bf1-84c5-4be0fb5df69d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.157637 Aug 25 05:17:10.245106 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 230/458] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:10 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:10.571726 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-33c54e6e-c6f7-43f7-9372-21491d323c13 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.964770 Aug 25 05:17:10.577841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 229/459] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:17:09 2022] POST /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments => generated 194 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:11.268225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:11.269568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:11.275211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:11.275686 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:11.276115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:11.276799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:11.277244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:11.277692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:11.408463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:11.416995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:11.418829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:11.419972 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3d54031e-3de5-4d90-bcc1-3ee85df1f2bd tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.155640 Aug 25 05:17:11.420520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 231/460] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:11 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:12.444119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:12.444982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:12.451846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:12.452419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:12.452752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:12.453415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:12.453893 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:12.454307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:12.593088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:12.601320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:12.605892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:12.605892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-28944612-75a0-4b45-9abb-93f89a6095e4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.164250 Aug 25 05:17:12.605892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 230/461] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:12 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:12.723486 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:12.724023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:12.730347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:12.731669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:12.732266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:12.732951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:12.733856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:12.734448 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:12.759706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d919a8c0-5ff2-4745-94f2-68701e7a67a7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/ips" status: 200 len: 147 microversion: 2.1 time: 0.040192 Aug 25 05:17:12.760270 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 232/462] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:17:12 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:13.626735 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:13.627332 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:13.633626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:13.634105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:13.634562 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:13.635242 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:13.635687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:13.636102 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:13.765164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:13.773305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:13.774850 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:13.775988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-38c514b1-aa25-4eb5-a275-062481988aa3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.153171 Aug 25 05:17:13.776544 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 231/463] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:13 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:14.799765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:14.800365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:14.806759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:14.807227 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:14.807647 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:14.808316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:14.808754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:14.809822 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:14.933382 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:14.942283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:14.943762 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:14.944891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-72ce7552-7cc2-4eab-915b-85416e7db6a5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.149028 Aug 25 05:17:14.945441 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 233/464] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:14 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:15.968736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:15.969337 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:15.975836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:15.977330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:15.977330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:15.977536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:15.977940 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:15.978356 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:16.109473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:16.116362 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:16.117878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:16.119005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fe1883e5-8916-4d5c-9c8b-b772cabb3442 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.155056 Aug 25 05:17:16.119554 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 232/465] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:15 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:16.339902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27278dcb-7ec2-46e7-911b-8a68c95383e6"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:16.343243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:16.349659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:16.350138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:16.350595 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:16.351280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:16.351725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:16.352148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:17.069358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6d993526-1b03-42b3-b780-4176dbf55a42 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733255 Aug 25 05:17:17.070033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 234/466] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:17:16 2022] POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:17.141089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:17.141749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:17.148145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:17.162531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:17.162531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:17.162531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:17.162531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:17.162890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:17.280345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:17.289427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:17.290941 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:17.292275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-63e240b7-a58c-43c6-b5b3-b62adfa850ab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.154904 Aug 25 05:17:17.292659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 233/467] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:17 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:18.317148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:18.317868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:18.327488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:18.327930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:18.328541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:18.329233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:18.329715 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:18.330120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:18.459674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:18.467943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:18.469469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:18.470646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6d0b7d31-b389-470d-b4e6-a7c69dbf50e5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.158196 Aug 25 05:17:18.471219 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 235/468] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:18 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:19.484364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fa1f9bb8-d7d7-41f3-b3ac-7cb74387d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: .version_select at 0x7f2423cc0d30>, body: {"keypair": {"name": "tempest-keypair-1540564945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzwTC86orrdS1AGkWPSRMqkFaQjV3eDl7JKgtLJ3c66OhSxgMPtRBKrsJ+pEl2e4pZUZJi2SIVrxX/h+/87vUjkScXeE4MU9omAhKgSkG68D/VnVgP8I+FwN+WHcp81Xg=="}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:19.497170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:19.497170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:19.500642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-fa1f9bb8-d7d7-41f3-b3ac-7cb74387d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:17:19.501877 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:19.502367 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:19.502898 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:19.503720 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:19.504347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:19.504654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-fa1f9bb8-d7d7-41f3-b3ac-7cb74387d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:17:19.504831 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:19.632487 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fa1f9bb8-d7d7-41f3-b3ac-7cb74387d437 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151751 Aug 25 05:17:19.633169 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 234/469] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:17:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:19.876165 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:19.884766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:19.886304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:19.887704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4fae29d5-5324-43f5-bff9-3c2d2b39ca16 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.397291 Aug 25 05:17:19.888186 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 236/470] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:19 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:20.911721 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:20.912396 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:20.919004 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:20.919482 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:20.919901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:20.920585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:20.921074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:20.921539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:20.924389 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:21.129822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:21.134960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:21.136731 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:21.139473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-35dd15ad-189e-4bbb-abbe-47d2075a331f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.232206 Aug 25 05:17:21.140887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 235/471] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:20 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:21.955965 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1362735523", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f1da36-d799-4803-8568-258dd71a0604"}], "security_groups": [{"name": "tempest-securitygroup--1815543204"}], "key_name": "tempest-keypair-1540564945", "user_data": "}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:22.059589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] validate_networks() for [('68f1da36-d799-4803-8568-258dd71a0604', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:17:22.163336 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:22.164049 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:22.166857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:22.172738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:22.173222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:22.173681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:22.174370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:22.174811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:22.175225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:22.315918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:22.324427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:22.325959 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:22.327621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-70793688-f8d5-40dc-872d-353eed9eab4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.167914 Aug 25 05:17:22.328468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 236/472] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:22 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:22.438731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:17:22.439143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:17:22.439601 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:17:22.439995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:17:22.440393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:17:22.449222 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:22.449725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:22.450141 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:22.450847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:22.451284 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:22.451692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:22.469408 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:17:22.473325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:17:22.484448 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:17:22.486869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:17:22.674037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-78849ce7-ea01-46a1-87fc-0d6a8ae220f2 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.722264 Aug 25 05:17:22.674718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 237/473] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:17:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:17:22.685729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-78b9be0b-07b4-433a-bc7d-adebd4193ada tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:22.692992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-78b9be0b-07b4-433a-bc7d-adebd4193ada tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:22.744703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-78b9be0b-07b4-433a-bc7d-adebd4193ada tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:22.752686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-78b9be0b-07b4-433a-bc7d-adebd4193ada tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1242 microversion: 2.1 time: 0.070900 Aug 25 05:17:22.753264 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 237/474] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:22 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:23.351681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:23.352500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:23.364880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:23.366772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:23.367546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:23.368256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:23.368705 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:23.369123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:23.538056 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:23.546825 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:23.548329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:23.549477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c7498ec8-0260-4f5d-b308-921b842d11d7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.202157 Aug 25 05:17:23.561909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 238/475] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:23 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:23.774368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:23.775046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:23.781951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:23.782418 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:23.782841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:23.783515 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:23.783956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:23.784365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:23.848387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:23.856254 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-84e7e6c4-002d-4f57-a4a6-f0dc84264f82 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1246 microversion: 2.1 time: 0.086105 Aug 25 05:17:23.856827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:23 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:24.573416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:24.574637 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:24.581495 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:24.582043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:24.582426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:24.583114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:24.583551 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:24.583966 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:24.716428 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:24.725635 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:24.727131 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:24.737728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f6bd9af9-1e52-4ab0-b4a7-b16f4b16691c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.159010 Aug 25 05:17:24.737728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:24 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:24.876858 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:24.877999 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:24.884334 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:24.884805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:24.885225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:24.885939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:24.886377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:24.886787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:24.956820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:24.964442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f6abf8a9-811d-4390-a983-a5d60cdbb8c8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1294 microversion: 2.1 time: 0.091480 Aug 25 05:17:24.965015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 239/478] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:24 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:25.064954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-341e422e-455e-4281-b77e-4a45d3cef3e9 req-649f9596-b333-40f3-afff-d6ab9e3d370b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070a4cc0-c2a7-4e19-b265-7c540dc6f045", "name": "network-vif-plugged", "status": "completed", "tag": "918a320b-9189-42f8-9052-24cef6e0d004"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:25.070064 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:25.075176 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-341e422e-455e-4281-b77e-4a45d3cef3e9 req-649f9596-b333-40f3-afff-d6ab9e3d370b service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:25.075646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-341e422e-455e-4281-b77e-4a45d3cef3e9 req-649f9596-b333-40f3-afff-d6ab9e3d370b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:25.076057 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-341e422e-455e-4281-b77e-4a45d3cef3e9 req-649f9596-b333-40f3-afff-d6ab9e3d370b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:25.087568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-341e422e-455e-4281-b77e-4a45d3cef3e9 req-649f9596-b333-40f3-afff-d6ab9e3d370b service nova] Creating event network-vif-plugged:918a320b-9189-42f8-9052-24cef6e0d004 for instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 on hv-cinder-85391 Aug 25 05:17:25.092488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-341e422e-455e-4281-b77e-4a45d3cef3e9 req-649f9596-b333-40f3-afff-d6ab9e3d370b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 Aug 25 05:17:25.093342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 240/479] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:25.751985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:25.752599 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:25.758725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:25.759207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:25.759635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:25.760323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:25.760871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:25.761170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:25.894052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:25.903111 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:25.904654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:25.905837 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0d01de4d-7236-4154-b360-b451596b2c44 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.158218 Aug 25 05:17:25.909638 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 240/480] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:25 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:25.986105 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:25.986766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:25.993876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:25.994354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:25.994780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:25.995463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:25.995904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:25.996319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:26.076820 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:26.085300 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cd60b7a4-6b6d-4f0b-87bb-58d2ddadf3d4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1294 microversion: 2.1 time: 0.103477 Aug 25 05:17:26.085971 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 241/481] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:25 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:26.932181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:26.933422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:26.944108 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:26.945144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:26.945878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:26.960623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:26.960623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:26.960623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:27.107034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:27.107902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:27.114919 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:27.115389 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:27.119289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:27.119289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:27.119289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:27.119289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:27.131857 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:27.178870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:27.179887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:27.188649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:27.188892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-dce664f1-02f3-40fa-9104-36f3328b41bc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1300 microversion: 2.1 time: 0.085559 Aug 25 05:17:27.189262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 242/482] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:27 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:27.191286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:27.192515 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-39c32812-6566-4093-b1f3-8989df9893ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.265474 Aug 25 05:17:27.194862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 241/483] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:26 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:27.818589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-260ea02c-c772-4708-806a-6265ff36fbec tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:27.825579 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-260ea02c-c772-4708-806a-6265ff36fbec tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:27.826163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-260ea02c-c772-4708-806a-6265ff36fbec tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:27.826664 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-260ea02c-c772-4708-806a-6265ff36fbec tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:27.890116 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-260ea02c-c772-4708-806a-6265ff36fbec tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Going to try to stop instance {{(pid=121314) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 05:17:28.051845 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-260ea02c-c772-4708-806a-6265ff36fbec tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action" status: 202 len: 0 microversion: 2.1 time: 0.237408 Aug 25 05:17:28.054980 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 243/484] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:17:27 2022] POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:17:28.062871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:28.063624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:28.074274 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:28.077104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:28.077104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:28.077104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:28.077104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:28.077432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:28.211140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:28.211870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:28.218288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:28.218775 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:28.219203 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:28.219897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:28.220345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:28.220796 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:28.241268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:28.250484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-edc29faf-261d-4a1d-8114-1b2ae4eebadc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.192883 Aug 25 05:17:28.251079 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 242/485] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:28 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:28.264861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:28.264861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:28.270163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:28.270163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:28.270163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:28.270163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:28.270497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:28.270497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:28.357913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:28.366555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6029e7f9-6f55-4ccc-9e47-7174b4bc4077 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.160422 Aug 25 05:17:28.367331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 244/486] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:28 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:28.474153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:28.482479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:28.483970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:28.485442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-94a39570-dfbb-4ba5-83c4-517c023b2d5c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.231746 Aug 25 05:17:28.486036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 243/487] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:28 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:28.637779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-6c45fc48-a605-49e1-80a3-2cea298c4e81 req-b4cfd30b-26c5-4a17-bb32-ec7049ef7283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf9300a-25b9-43ef-929f-cdc1eb6542d9", "tag": "f4ebc47f-9013-4fcf-a0a0-6d37bb85449a"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:28.647827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6c45fc48-a605-49e1-80a3-2cea298c4e81 req-b4cfd30b-26c5-4a17-bb32-ec7049ef7283 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:28.648291 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6c45fc48-a605-49e1-80a3-2cea298c4e81 req-b4cfd30b-26c5-4a17-bb32-ec7049ef7283 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:28.648707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6c45fc48-a605-49e1-80a3-2cea298c4e81 req-b4cfd30b-26c5-4a17-bb32-ec7049ef7283 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:28.659396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-6c45fc48-a605-49e1-80a3-2cea298c4e81 req-b4cfd30b-26c5-4a17-bb32-ec7049ef7283 service nova] Creating event network-changed:f4ebc47f-9013-4fcf-a0a0-6d37bb85449a for instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 on hv-cinder-85391 Aug 25 05:17:28.664814 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-6c45fc48-a605-49e1-80a3-2cea298c4e81 req-b4cfd30b-26c5-4a17-bb32-ec7049ef7283 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031559 Aug 25 05:17:28.665406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 245/488] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:29.272253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:29.272856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:29.279360 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:29.279869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:29.280299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:29.280986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:29.281435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:29.282555 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:29.388580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:29.389377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:29.395979 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:29.396461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:29.396892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:29.397615 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:29.398093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:29.398515 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:29.487565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:29.496087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-996daf54-ef41-45df-bf9a-c3924d831a82 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.227613 Aug 25 05:17:29.496662 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 244/489] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:29 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:29.510859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:29.511477 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:29.517642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:29.518131 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:29.518569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:29.519261 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:29.519710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:29.520318 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:29.532430 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:29.540690 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1afc4d0f-3be8-4a1a-a84a-eba4957187c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.156460 Aug 25 05:17:29.541274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 246/490] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:29 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:29.650623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:29.659271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:29.660757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:29.661920 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7191021d-5358-4087-9a42-27aa44597f8b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.155169 Aug 25 05:17:29.662461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 245/491] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:29 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:30.518653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:30.519213 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:30.525644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:30.526127 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:30.526559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:30.527244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:30.527695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:30.528120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:30.562136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:30.562739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:30.569184 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:30.569697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:30.570125 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:30.570817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:30.571263 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:30.571671 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:30.656174 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:30.665071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5119b934-c669-4198-844e-97624f12ff6b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.150852 Aug 25 05:17:30.665771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 247/492] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:30 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:30.683988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:30.684590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:30.691203 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:30.822460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:30.822460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:30.822460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:30.822460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:30.823035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:30.823321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:30.823321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-47d028cc-15fa-40d4-8ecf-26b6a3e1a389 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.155901 Aug 25 05:17:30.823321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 246/493] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:30 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:30.832381 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:30.840458 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:30.841980 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:30.843365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f789f718-d577-4eed-a770-da2e8e3a147c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.162890 Aug 25 05:17:30.843913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 248/494] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:30 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:31.686312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:31.686918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:31.693296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:31.693805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:31.694237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:31.694918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:31.695364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:31.695780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:31.736138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:31.736740 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:31.744010 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:31.744485 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:31.744909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:31.745612 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:31.746130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:31.746541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:31.826428 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:31.835276 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-16cdcda8-091f-493c-abda-e315d673a0f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.152725 Aug 25 05:17:31.835857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 247/495] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:31 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:31.865710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:31.866326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:31.872280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:31.872766 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:31.873198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:31.873972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:31.874425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:31.874849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:31.876278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:31.890215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bf95a35a-9e5c-4580-83b5-53d7048a18a3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.157824 Aug 25 05:17:31.890786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 249/496] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:31 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:32.005938 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:32.014059 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:32.015567 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:32.016732 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2a5f47a3-4041-4e07-9b70-2e185209448d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1744 microversion: 2.20 time: 0.155010 Aug 25 05:17:32.017289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 248/497] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:31 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:32.856792 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:32.857379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:32.859356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:32.860009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=6 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:32.865194 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:32.865706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:32.866140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:32.866862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:32.867317 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:32.867755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:32.913636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:32.914839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:32.917162 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=6 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:32.923043 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:32.923520 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:32.923942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:32.924629 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:32.925067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:32.925832 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:33.035519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:33.044031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6a16fe7e-29d0-4574-a920-fc76cbe3f3b7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.191193 Aug 25 05:17:33.056607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 250/498] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:32 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:33.056607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:33.056607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:33.056607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:33.057080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:33.058185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:33.063547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:33.063547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:33.063547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:33.094296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:33.102143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ba59df1b-9374-44b5-9d19-1119b0870666 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.194344 Aug 25 05:17:33.102725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 249/499] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:32 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:33.207847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:33.216298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:33.218499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:33.219895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-04c29284-5f78-4f86-aff7-a3cd881b6a4d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.174273 Aug 25 05:17:33.220920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 251/500] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:33 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:34.065659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:34.066193 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:34.075031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:34.075887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:34.076428 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:34.077196 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:34.077777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:34.078285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:34.123669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:34.124610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:34.131195 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:34.131964 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:34.132686 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:34.133616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:34.134261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:34.134926 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:34.271380 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:34.285680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:34.286046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4a60b60a-ce93-4c37-ac9f-753c6bf35a61 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.224231 Aug 25 05:17:34.286715 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 250/501] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:34 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:34.294673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:34.295102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f77d1119-68d7-476e-84d5-fcf0b4c08e89 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.175981 Aug 25 05:17:34.295686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:34.304258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:34.304763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:34.305414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:34.306206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:34.306715 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:34.307196 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:34.309815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 252/502] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:34 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:34.467777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:34.476925 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:34.478516 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:34.479981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3a7b9d99-236b-49dc-9fad-922509b643d1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.192093 Aug 25 05:17:34.480872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 251/503] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:34 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:35.309571 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:35.312448 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:35.314635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-c2ca8c47-8bfd-438c-9e3b-f1bc6b0f1c01 req-6f331101-065d-44f8-a218-8b85741d468b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf9300a-25b9-43ef-929f-cdc1eb6542d9", "name": "network-vif-plugged", "status": "completed", "tag": "f4ebc47f-9013-4fcf-a0a0-6d37bb85449a"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:35.320365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:35.323493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:35.323493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:35.323493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:35.323493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:35.323867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:35.334782 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c2ca8c47-8bfd-438c-9e3b-f1bc6b0f1c01 req-6f331101-065d-44f8-a218-8b85741d468b service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:35.336132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c2ca8c47-8bfd-438c-9e3b-f1bc6b0f1c01 req-6f331101-065d-44f8-a218-8b85741d468b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:35.337262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c2ca8c47-8bfd-438c-9e3b-f1bc6b0f1c01 req-6f331101-065d-44f8-a218-8b85741d468b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:35.351147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-c2ca8c47-8bfd-438c-9e3b-f1bc6b0f1c01 req-6f331101-065d-44f8-a218-8b85741d468b service nova] Creating event network-vif-plugged:f4ebc47f-9013-4fcf-a0a0-6d37bb85449a for instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 on hv-cinder-85391 Aug 25 05:17:35.359425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-c2ca8c47-8bfd-438c-9e3b-f1bc6b0f1c01 req-6f331101-065d-44f8-a218-8b85741d468b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048479 Aug 25 05:17:35.360485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 252/504] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:17:35.368922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:35.369853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:35.378023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:35.378593 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:35.379095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:35.379868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:35.380403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:35.380900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:35.406844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:35.534956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:35.544334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-21899b46-840c-4cc8-b0d6-9af24393ec05 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.238646 Aug 25 05:17:35.558829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 253/505] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:35 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:35.564044 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:35.566242 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:35.571422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:35.572206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:35.572809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:35.573510 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:35.574003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:35.574421 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:35.593786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:35.610106 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-488037a6-cc18-4b7b-a613-5b7a1c4ac630 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.247501 Aug 25 05:17:35.612247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 253/506] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:35 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:35.746400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:35.756016 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:35.757803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:35.759315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-485fb7b2-a5a5-41b6-9b80-54b38bd4b0f9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.199165 Aug 25 05:17:35.759940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 254/507] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:35 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:36.566922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:36.567449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:36.573934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:36.574414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:36.574844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:36.575536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:36.575982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:36.576405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:36.631592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:36.632190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:36.638663 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:36.639132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:36.639559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:36.640324 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:36.640763 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:36.641174 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:36.723773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:36.732425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c2260fe9-d747-4d15-b22b-582d0eb885ae tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.170060 Aug 25 05:17:36.733270 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 254/508] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:36 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:36.788230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:36.789230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:36.796081 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:36.796851 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:36.797431 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:36.798185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:36.798797 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:36.799956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:36.819740 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:36.828396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a5f7d9a0-9134-4bb3-8e58-d9e2fdaaa66c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1368 microversion: 2.1 time: 0.200474 Aug 25 05:17:36.828396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:36 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:36.953066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:36.961434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:36.963410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:36.964870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8deab230-ad8e-4d54-bde0-e88832eb6e61 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.181935 Aug 25 05:17:36.965982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 255/510] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:36 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:37.758437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:37.759696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:37.769679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:37.770270 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:37.770767 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:37.771718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:37.772363 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:37.773060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:37.849073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:37.849656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:37.856436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:37.856930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:37.857508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:37.858255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:37.858966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:37.859604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:37.947732 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:37.958556 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9e31c4b2-6a7b-4da4-86a5-c2c5ac62193f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.204078 Aug 25 05:17:37.959508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 256/511] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:37 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:37.993012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:37.994017 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:38.004243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:38.005618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:38.006316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:38.007826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:38.010758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:38.012596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:38.112502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:38.122061 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-87a206ca-b11e-49c1-bb86-9c643f86f4b8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1558 microversion: 2.1 time: 0.277115 Aug 25 05:17:38.131218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 256/512] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:37 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1558 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:38.150818 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:38.158423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:38.158423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:38.158423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:38.158756 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:38.159349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:38.159790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:38.160204 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:38.196686 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:38.209364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:38.211036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:38.212520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7925c0bf-806c-45a2-bdb0-11a98c6875b8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.223942 Aug 25 05:17:38.213501 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 257/513] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:37 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:38.256739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dd489fad-6551-4461-9ede-0fdcd517deba tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109681 Aug 25 05:17:38.265603 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 257/514] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:17:38 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:17:38.980520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:38.981124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:38.992914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:38.993806 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:38.994502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:38.995561 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:38.998109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:38.998796 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:39.185158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:39.188355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:39.197449 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7dda3844-d350-462a-b07e-019e3057ce4e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.220923 Aug 25 05:17:39.198888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 258/515] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:38 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:39.236052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:39.241927 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:39.247958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:39.248442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:39.248872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:39.249576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:39.256844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:39.257500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:39.508868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:39.522067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:39.522743 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-8e0ced68-2a70-45e3-acd4-2d3014eb8b37 req-0132b685-2ec1-4048-becc-c2e3dcfc2794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf9300a-25b9-43ef-929f-cdc1eb6542d9", "tag": "f4ebc47f-9013-4fcf-a0a0-6d37bb85449a"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:39.523736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:39.524899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a3d8a7aa-a260-47cb-869c-01011b948004 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.292947 Aug 25 05:17:39.533545 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8e0ced68-2a70-45e3-acd4-2d3014eb8b37 req-0132b685-2ec1-4048-becc-c2e3dcfc2794 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:39.534227 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8e0ced68-2a70-45e3-acd4-2d3014eb8b37 req-0132b685-2ec1-4048-becc-c2e3dcfc2794 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:39.534663 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-8e0ced68-2a70-45e3-acd4-2d3014eb8b37 req-0132b685-2ec1-4048-becc-c2e3dcfc2794 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:39.538288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 258/516] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:39 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:39.548384 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-8e0ced68-2a70-45e3-acd4-2d3014eb8b37 req-0132b685-2ec1-4048-becc-c2e3dcfc2794 service nova] Creating event network-changed:f4ebc47f-9013-4fcf-a0a0-6d37bb85449a for instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 on hv-cinder-85391 Aug 25 05:17:39.554248 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-8e0ced68-2a70-45e3-acd4-2d3014eb8b37 req-0132b685-2ec1-4048-becc-c2e3dcfc2794 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035409 Aug 25 05:17:39.554726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 259/517] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:17:40.221645 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:40.222650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:40.242152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:40.243387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:40.244007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:40.244892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:40.245844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:40.247117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:40.547182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:40.554514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:40.555225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:40.564520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:40.566727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:40.567173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:40.567991 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:40.568512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:40.569053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:40.573350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6cadf871-701d-418a-b4e5-1cbea870c29b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.355862 Aug 25 05:17:40.574961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 259/518] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:40 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:40.747031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:40.756373 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:40.758793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:40.759956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1d2bb151-edd2-45c8-81b9-6ff104111432 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.211313 Aug 25 05:17:40.760592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 260/519] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:40 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:41.597258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:41.598519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:41.605116 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:41.605621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:41.606056 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:41.606737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:41.607207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:41.607637 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:41.775287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:41.784300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8e85280c-9aef-41f3-ad92-1931262afd25 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.192089 Aug 25 05:17:41.784791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:41.785477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:41.794925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:41.796221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:41.797623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:41.798614 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 260/520] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:41 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:41.798752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:41.799752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:41.800252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:41.977550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:41.985840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:41.987938 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:41.989940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-60bbc3e8-1ec0-43f9-a359-11e958c6ed0f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.209558 Aug 25 05:17:41.989940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 261/521] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:41 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:42.805284 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:42.819483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:42.819483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:42.819483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:42.819483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:42.819881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:42.819881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:42.819881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:42.948368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:42.958259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-39d46dc2-06d8-4d68-b3bf-4d299c3adbf8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.156745 Aug 25 05:17:42.958870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 261/522] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:42 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:43.012343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:43.012979 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:43.020043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:43.020518 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:43.020947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:43.021657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:43.022107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:43.022524 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:43.151525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:43.160553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:43.162098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:43.163243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bed49d36-f78e-41c8-8f37-29a31ea6e9bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.154837 Aug 25 05:17:43.164116 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 262/523] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:43 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:43.985101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:43.985823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:43.992403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:43.992886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:43.993318 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:43.994069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:43.994721 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:43.995144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:44.130819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:44.139958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-25506612-b4e6-4958-ae15-92659f4f1580 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.163501 Aug 25 05:17:44.140551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 262/524] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:43 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:44.187635 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:44.188230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:44.195529 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:44.195998 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:44.196422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:44.197097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:44.197537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:44.197977 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:44.327480 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:44.336082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:44.337573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:44.338758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2897952a-841a-4493-a812-bca85683f5cb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.155313 Aug 25 05:17:44.339309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 263/525] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:44 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:45.162294 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:45.162895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:45.169262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:45.169771 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:45.170198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:45.170883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:45.171329 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:45.171745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:45.302051 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:45.310340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4076c38d-6795-4934-9bad-ede9148878c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.152464 Aug 25 05:17:45.310908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 263/526] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:45 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:45.361264 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:45.361873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:45.368341 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:45.368823 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:45.369254 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:45.369977 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:45.370435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:45.370857 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:45.503199 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:45.511274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:45.512779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:45.513958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2b676d65-2aa3-47ac-b3d5-1a30159170ca tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1739 microversion: 2.20 time: 0.156521 Aug 25 05:17:45.514508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 264/527] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:45 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:46.331060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:46.331597 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:46.337975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:46.338444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:46.338869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:46.339540 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:46.339984 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:46.340397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:46.465780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:46.474791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4b908604-af51-4c1d-af78-084c24a3b94a tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.147601 Aug 25 05:17:46.480394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 264/528] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:46 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:46.537689 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:46.538301 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:46.544735 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:46.545211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:46.545676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:46.546368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:46.546818 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:46.547241 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:46.674255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:46.683074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:46.684572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:46.685736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-65fbc945-7c1c-4d49-82c8-2db3e725bc86 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1721 microversion: 2.20 time: 0.152575 Aug 25 05:17:46.686289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 265/529] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:46 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:47.502419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:47.503632 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:47.509703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:47.510183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:47.510609 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:47.511288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:47.511734 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:47.512152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:47.642280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:47.650418 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a1388255-f794-4414-9c79-bb935283385f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.156244 Aug 25 05:17:47.651018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 265/530] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:47 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:47.709084 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:47.709833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:47.716210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:47.716685 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:47.717115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:47.717832 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:47.718543 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:47.718962 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:47.849102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:47.858042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:47.859547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:47.860692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-13fc435a-dece-44bc-954d-ecb4cd0d4d30 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1721 microversion: 2.20 time: 0.155631 Aug 25 05:17:47.861252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 266/531] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:47 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:48.671179 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:48.671783 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:48.678306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:48.678779 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:48.679204 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:48.679879 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:48.680321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:48.680736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:48.810871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:48.819624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-474d1a4e-9561-45f3-88f4-1d7ef3f4293b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1725 microversion: 2.1 time: 0.152277 Aug 25 05:17:48.820201 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 266/532] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:48 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:48.883508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:48.884105 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:48.890826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:48.896645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:48.896645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:48.896645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:48.896645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:48.896997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:49.023051 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:49.031251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:49.032731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:49.033898 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a52f1f0b-54f4-4bf8-b3b2-5861239aea8a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1724 microversion: 2.20 time: 0.154262 Aug 25 05:17:49.034942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 267/533] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:48 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:49.058244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb73f2e0-7eca-49c4-90d5-dcf7dacb2d4e"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:49.060608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:49.066628 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:49.067099 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:49.067536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:49.068216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:49.068662 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:49.069074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:49.352678 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-39e7adf3-7750-4814-b73c-d019c6edc1e2 req-471c411b-de86-40e1-8bf3-4902f7afe586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070a4cc0-c2a7-4e19-b265-7c540dc6f045", "name": "network-vif-unplugged", "status": "completed", "tag": "918a320b-9189-42f8-9052-24cef6e0d004"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:49.361851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-39e7adf3-7750-4814-b73c-d019c6edc1e2 req-471c411b-de86-40e1-8bf3-4902f7afe586 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:49.362345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-39e7adf3-7750-4814-b73c-d019c6edc1e2 req-471c411b-de86-40e1-8bf3-4902f7afe586 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:49.362760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-39e7adf3-7750-4814-b73c-d019c6edc1e2 req-471c411b-de86-40e1-8bf3-4902f7afe586 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:49.373389 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.compute.server_external_events [req-39e7adf3-7750-4814-b73c-d019c6edc1e2 req-471c411b-de86-40e1-8bf3-4902f7afe586 service nova] Unable to find a host for instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045. Dropping event network-vif-unplugged {{(pid=121314) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 05:17:49.380405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-39e7adf3-7750-4814-b73c-d019c6edc1e2 req-471c411b-de86-40e1-8bf3-4902f7afe586 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025330 Aug 25 05:17:49.380405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 268/534] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 25 05:17:49.840427 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:49.841059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:49.847870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:49.848368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:49.848791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:49.849466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:49.849940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:49.850353 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:49.976707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:49.984920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7fd21a46-dacd-4815-889c-b358efd9ef16 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1702 microversion: 2.1 time: 0.148277 Aug 25 05:17:49.985489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 269/535] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:49 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1702 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:17:50.005814 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1ebcc9a6-051f-4507-a01c-f30441c9c8be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:50.011854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ebcc9a6-051f-4507-a01c-f30441c9c8be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:50.012068 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ebcc9a6-051f-4507-a01c-f30441c9c8be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:50.012505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ebcc9a6-051f-4507-a01c-f30441c9c8be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:50.033932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1ebcc9a6-051f-4507-a01c-f30441c9c8be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Going to try to start instance {{(pid=121314) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 05:17:50.106493 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:50.201483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0bb6ddf8-76bf-4257-b777-3e5d4734a450 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.147219 Aug 25 05:17:50.202170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 267/536] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Aug 25 05:17:49 2022] POST /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments => generated 188 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:17:50.205405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1ebcc9a6-051f-4507-a01c-f30441c9c8be tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action" status: 202 len: 0 microversion: 2.1 time: 0.203745 Aug 25 05:17:50.206522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 270/537] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:17:50 2022] POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:17:50.219047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:50.219047 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:50.226883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:50.227384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:50.227947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:50.228712 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:50.229525 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:50.230034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:50.331865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:50.332546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:50.338780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:50.339292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:50.339835 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:50.340522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:50.340963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:50.341375 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:50.371971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:50.381711 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-42332a71-0aa5-4c6e-9a24-72ea8bfffa19 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1711 microversion: 2.1 time: 0.171100 Aug 25 05:17:50.382576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 268/538] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:50 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1711 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:50.392411 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121314) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 05:17:50.678808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a2a3a1d4-3db3-4944-877f-d5e5b7f69493 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/action" status: 202 len: 0 microversion: 2.20 time: 0.351215 Aug 25 05:17:50.682553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 271/539] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Aug 25 05:17:50 2022] POST /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 05:17:50.688000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:50.688794 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:50.695770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:50.696320 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:50.696825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:50.697958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:50.698258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:50.698752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:50.901824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:50.911283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:50.913076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:50.914312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d0773810-b403-411a-b040-afc970eea069 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1750 microversion: 2.20 time: 0.230299 Aug 25 05:17:50.915058 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 269/540] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:50 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:51.403246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:51.403854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:51.409868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:51.410351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:51.410781 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:51.411461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:51.411905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:51.412354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:51.547369 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:51.556457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-20423120-4214-4d10-89a0-85a08219ced4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1711 microversion: 2.1 time: 0.157496 Aug 25 05:17:51.557048 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 272/541] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:51 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:51.936353 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:51.936978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:51.943397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:51.943862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:51.944271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:51.944943 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:51.945381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:51.945818 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:52.076494 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:52.086092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:52.092387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:52.092387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-92e11ae6-409c-46a6-879e-5dc298d0f84a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1750 microversion: 2.20 time: 0.156324 Aug 25 05:17:52.092387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 270/542] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:51 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:52.578022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:52.578639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:52.585279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:52.585805 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:52.589171 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:52.589171 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:52.589171 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:52.589171 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:52.720169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:52.729074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0c36e989-4f35-49f6-aef5-d2ad6bd94955 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1715 microversion: 2.1 time: 0.155082 Aug 25 05:17:52.729655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 273/543] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:17:52 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:17:53.111507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:53.112041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:53.118432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:53.119042 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:53.119470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:53.120144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:53.120585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:53.120999 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:53.248489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:53.257748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:53.259291 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:53.260436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a61b8516-ccd1-405c-a224-65b599d91dff tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1752 microversion: 2.20 time: 0.152892 Aug 25 05:17:53.260986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 271/544] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:53 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:53.894108 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3320577-6a62-4a61-9414-d808af57633b"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:17:53.896511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:53.902685 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:53.903162 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:53.903591 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:53.904274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:53.904713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:53.905124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:53.974504 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:54.284570 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:54.285174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:54.287576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=74 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:54.292210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:54.292684 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:54.293118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:54.293838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:54.294285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:54.294703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:54.426592 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:54.435423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:54.436936 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:54.438140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-863585e8-f060-4225-be58-23e780961d32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.158103 Aug 25 05:17:54.438679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 272/545] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:54 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:17:54.618087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d729e787-6522-425e-aeb9-9921ef4c55a7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727882 Aug 25 05:17:54.618699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 274/546] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:17:53 2022] POST /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:17:55.462161 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:55.462807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:55.469698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:55.470171 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:55.473031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:55.473031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:55.473031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:55.473031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:55.608486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:55.618088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:55.619949 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:55.623967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7a94a8e3-59d8-4f2f-9143-6a10ef926843 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.163025 Aug 25 05:17:55.624621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 273/547] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:55 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:56.649922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:56.650827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:56.652897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:17:56.657935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:56.658611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:56.659710 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:56.660587 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:56.661173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:56.661616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:56.810250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:56.827240 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:56.828892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:56.830193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6516866b-2257-4330-8af5-7d5b0baee2a8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.185057 Aug 25 05:17:56.831725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 275/548] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:56 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:57.853915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:57.855030 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:57.863706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:57.865008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:57.865566 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:57.872137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:57.872855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:57.873502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:58.008960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:58.017894 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:58.031517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:58.031517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0f8b142c-4444-4908-a314-975e697d9494 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.170800 Aug 25 05:17:58.031517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 274/549] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:57 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:17:59.044091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:17:59.044699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:17:59.051690 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:59.052159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:59.052599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:59.053271 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:17:59.053740 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:17:59.054154 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:17:59.187303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:59.197524 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:59.199039 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:17:59.200185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7416adb0-237b-4aba-b25d-1e240e7b47fe tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.160141 Aug 25 05:17:59.200931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 276/550] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:17:59 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:00.238062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:00.238672 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:00.245329 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:00.246141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:00.246587 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:00.247280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:00.247726 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:00.248144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:00.388633 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:00.397803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:00.399287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:00.400448 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-634ca961-2f5f-422c-a9df-442ed534c297 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.167042 Aug 25 05:18:00.400998 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 275/551] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:00 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:01.424055 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:01.430479 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:01.431695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:01.432161 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:01.432588 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:01.433263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:01.433790 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:01.434184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:01.571925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:01.580629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:01.582147 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:01.583345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2e2fd12d-97b2-414e-a0cd-484faa8a6975 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.163182 Aug 25 05:18:01.583917 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 277/552] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:01 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:02.606849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:02.607461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:02.614759 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:02.615573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:02.616217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:02.617238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:02.618034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:02.618676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:02.759275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:02.769696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:02.771207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:02.772397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fd23a2f3-159e-4cff-a214-fa4d8ab4e608 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.169522 Aug 25 05:18:02.772964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 276/553] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:02 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:03.796947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:03.797691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:03.804792 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:03.805265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:03.805727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:03.806409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:03.806849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:03.807263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:03.940931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:03.950137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:03.951895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:03.953101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e8da2071-4abe-426c-a5d6-caa018c38d94 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.160093 Aug 25 05:18:03.953685 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 278/554] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:03 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:04.977464 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:04.979443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:04.989326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:04.990249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:04.990700 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:04.991390 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:04.991831 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:04.992243 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:05.123321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:05.132570 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:05.134115 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:05.135259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-74f120ec-f83b-4811-b81d-7d3ce5607342 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.162919 Aug 25 05:18:05.135814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 277/555] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:04 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:06.158404 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:06.159011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:06.165310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:06.165820 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:06.166249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:06.166930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:06.167371 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:06.167831 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:06.294223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:06.305933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:06.305933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:06.307180 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-13dfcae8-2909-44bc-82f6-f8f705ee8632 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.152212 Aug 25 05:18:06.307516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 279/556] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:06 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:07.331143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:07.331766 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:07.338084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:07.338553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:07.338979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:07.339649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:07.340086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:07.340496 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:07.479613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:07.488255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:07.489867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:07.491015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0eb32cb0-8115-449a-89cc-f3282ffe7690 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.164308 Aug 25 05:18:07.491576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 278/557] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:07 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:08.514279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:08.514801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:08.521239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:08.521746 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:08.522170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:08.522845 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:08.523280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:08.523688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:08.654420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:08.663480 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:08.664960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:08.666129 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3c21c0d4-e427-4b31-bd86-e5f7147a0e6a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.155948 Aug 25 05:18:08.666682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 280/558] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:08 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:09.688316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:09.688911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:09.695933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:09.696398 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:09.696820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:09.697491 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:09.698029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:09.698438 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:09.824068 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:09.832625 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:09.834139 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:09.835269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c3a06792-41f9-4be6-984f-46a7698758c6 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.150800 Aug 25 05:18:09.835819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 279/559] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:09 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:10.894778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:10.894778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:10.894778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:10.894778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:10.895669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:10.895669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:10.895669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:10.895669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:11.014711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:11.024969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:11.026794 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:11.028205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-201e6e5a-45d7-43cc-b0be-0b894ec54c60 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.173384 Aug 25 05:18:11.028932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 281/560] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:10 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:12.054231 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:12.054830 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:12.061512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:12.062015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:12.062441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:12.063112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:12.063552 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:12.063964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:12.194315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:12.202965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:12.209272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:12.209272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bfaaa693-b562-4559-9096-afaa4a657994 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.155299 Aug 25 05:18:12.209272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 280/561] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:12 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:12.760053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:18:12.762362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:12.768899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:12.769370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:12.769844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:12.770528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:12.771044 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:12.771457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:12.794238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lazy-loading 'flavor' on Instance uuid e79e79a1-46cc-437a-8c59-452ad20d1c13 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:18:13.086624 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3c28259b-2c85-4315-80d4-053395bd7fba tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/action" status: 200 len: 32 microversion: 2.1 time: 0.330381 Aug 25 05:18:13.087151 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 282/562] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:18:12 2022] POST /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/action => generated 32 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:18:13.097476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:13.098663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:13.105062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:13.105535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:13.105993 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:13.106674 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:13.107119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:13.107530 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:13.230527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:13.231466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:13.237956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:13.238512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:13.239014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:13.239781 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:13.240396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:13.240813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:13.245792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:13.254361 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-15aeface-875d-4c3e-b6e3-846094ccb64d tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.161647 Aug 25 05:18:13.254960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 281/563] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:13 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:18:13.373904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:13.382808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:13.384571 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:13.385756 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6c55745a-7662-421b-9b7b-7c6615ea00eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.159844 Aug 25 05:18:13.386319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 283/564] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:13 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:14.275367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:14.275972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:14.282351 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:14.282828 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:14.283257 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:14.283941 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:14.284882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:14.285298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:14.408803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:14.409029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:14.410149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:14.416682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:14.417159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:14.417615 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:14.417851 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-025f91ef-67fb-45ea-a5a8-b83a7cf9e51e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.146302 Aug 25 05:18:14.418308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:14.419156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 282/565] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:14 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:14.419307 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:14.419307 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:14.546170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:14.554713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:14.556211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:14.557348 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e13f8a8a-19e1-45d3-8670-1d58271b0d97 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.152184 Aug 25 05:18:14.557942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 284/566] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:14 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:18:15.439730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:15.440326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:15.447370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:15.447836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:15.448257 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:15.448929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:15.449369 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:15.449806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:15.580941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:15.580941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:15.581630 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:15.587170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:15.587644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:15.588066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:15.588747 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:15.589189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:15.589618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:15.589717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dc3f7ca2-2372-4e93-ba61-d7ae24dd4008 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.153764 Aug 25 05:18:15.590262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 283/567] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:15 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:15.716187 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:15.725536 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:15.727051 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:15.728180 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f9987327-03d8-4e7a-b544-019609351635 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.151922 Aug 25 05:18:15.728726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 285/568] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:15 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:16.610490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:16.611015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:16.617901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:16.618381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:16.618799 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:16.619499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:16.619942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:16.620357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:16.634561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=99 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:16.750903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:16.751802 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:16.752407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:16.758819 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:16.759238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a9039ee3-c174-453b-b968-78f1b0466412 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.152606 Aug 25 05:18:16.759361 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:16.759692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:16.759790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 284/569] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:16 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:16.763913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:16.764406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:16.764830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:16.894080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:16.902577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:16.904058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:16.905193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c24d3bdf-8eaf-4d41-bf12-4cf86c96287e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.157413 Aug 25 05:18:16.905775 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 286/570] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:16 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:18:17.780870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:17.781461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:17.788505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:17.788981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:17.789408 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:17.790121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:17.790562 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:17.790974 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:17.918359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:17.926487 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ef169bb8-86eb-49e9-9206-0d5632ca404e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.149555 Aug 25 05:18:17.927053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 285/571] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:17 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:17.928207 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:17.928815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:17.935359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:17.935833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:17.936312 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:17.936955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:17.937399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:17.937838 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:18.066359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:18.074904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:18.076425 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:18.077562 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ffc08de7-d213-455f-b316-5d31fd8bc9d9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.153270 Aug 25 05:18:18.078153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 287/572] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:17 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:18:18.947349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:18.948088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:18.954501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:18.954987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:18.955423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:18.956109 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:18.956561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:18.956983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:19.082057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:19.090120 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8d177533-c6f0-4f58-9a46-e0cf54803913 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.146658 Aug 25 05:18:19.090686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 286/573] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:18 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:19.100978 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:19.101581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:19.107964 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:19.108368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:19.108789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:19.109460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:19.109923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:19.110337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:19.112961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:19.242993 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:19.251547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:19.255334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:19.256515 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-276cdd0a-fad1-458d-8208-b9cac7e0ee7c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.159960 Aug 25 05:18:19.257068 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 288/574] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:19 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:20.113023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:20.113675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:20.120333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:20.120823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:20.121253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:20.121980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:20.122427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:20.122865 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:20.252934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:20.260989 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-838f91c6-93ca-403a-aa40-5c03fe2fd892 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.152485 Aug 25 05:18:20.261556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 287/575] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:20 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:20.279460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:20.280112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:20.287114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:20.287531 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:20.287957 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:20.288636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:20.289091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:20.289494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:20.413878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:20.422383 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:20.423901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:20.425692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-af17057b-4a78-4170-a208-2ff4a2378eee tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.149490 Aug 25 05:18:20.426245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 289/576] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:20 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:21.281812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:21.282417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:21.288803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:21.289278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:21.289731 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:21.290413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:21.290862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:21.291281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:21.418837 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:21.427629 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f10fe47d-0d11-4ee4-8946-4771f63fa138 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.149700 Aug 25 05:18:21.432974 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 288/577] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:21 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:21.456378 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:21.456979 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:21.463296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:21.467509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:21.467509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:21.467509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:21.467509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:21.467907 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:21.488187 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-ce1677bc-9717-4745-a82f-35bd6a3b2279 req-4681ed8f-e59c-4d44-8de3-664db2c1285c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070a4cc0-c2a7-4e19-b265-7c540dc6f045", "name": "network-vif-plugged", "status": "completed", "tag": "918a320b-9189-42f8-9052-24cef6e0d004"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:18:21.498041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ce1677bc-9717-4745-a82f-35bd6a3b2279 req-4681ed8f-e59c-4d44-8de3-664db2c1285c service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:21.498515 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ce1677bc-9717-4745-a82f-35bd6a3b2279 req-4681ed8f-e59c-4d44-8de3-664db2c1285c service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:21.498986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ce1677bc-9717-4745-a82f-35bd6a3b2279 req-4681ed8f-e59c-4d44-8de3-664db2c1285c service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:21.510763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-ce1677bc-9717-4745-a82f-35bd6a3b2279 req-4681ed8f-e59c-4d44-8de3-664db2c1285c service nova] Creating event network-vif-plugged:918a320b-9189-42f8-9052-24cef6e0d004 for instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 on hv-cinder-85391 Aug 25 05:18:21.515890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-ce1677bc-9717-4745-a82f-35bd6a3b2279 req-4681ed8f-e59c-4d44-8de3-664db2c1285c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032433 Aug 25 05:18:21.516489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 289/578] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:18:21.610517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:21.619785 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:21.621273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:21.622448 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3d1ca7fc-7b1f-4a30-9fd8-5b0906dfbcde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.170024 Aug 25 05:18:21.622993 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 290/579] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:21 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:22.450565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:22.451315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:22.458015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:22.458485 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:22.458909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:22.459583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:22.460026 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:22.460440 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:22.591037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:22.599676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5968e572-c96b-4330-bcb1-ac417a45e232 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.153771 Aug 25 05:18:22.600240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 290/580] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:22 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:22.645856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:22.646456 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:22.652643 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:22.653110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:22.653539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:22.654245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:22.654684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:22.655090 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:22.833037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:22.841573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:22.843173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:22.844576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-95c7c076-8a3a-4196-9ce1-1fa765e371e1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.203213 Aug 25 05:18:22.845124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 291/581] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:22 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:23.620334 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:23.620918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:23.627467 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:23.628065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:23.628493 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:23.629186 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:23.629686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:23.630109 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:23.756281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:23.764407 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9d0442b0-c036-4d62-8331-1af1c6db1af1 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.148072 Aug 25 05:18:23.764964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 291/582] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:23 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:23.866892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:23.867487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:23.873885 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:23.874719 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:23.875146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:23.875821 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:23.876261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:23.876670 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:24.002331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:24.011384 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:24.012800 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:24.013969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-aa3533cd-135f-400b-82f9-4c2e6caad0bc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.150903 Aug 25 05:18:24.014526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 292/583] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:23 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:24.786247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:24.786808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:24.789207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=40 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:24.793795 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:24.794323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:24.794752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:24.795429 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:24.795872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:24.796288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:24.974874 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:24.983476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bd4204ff-7d06-4e95-a565-19d903636953 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.201762 Aug 25 05:18:24.984060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 292/584] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:24 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:25.037103 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:25.037823 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:25.044491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:25.045048 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:25.045500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:25.046247 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:25.046699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:25.047121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:25.182483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:25.191111 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:25.192646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:25.193843 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e4c18a83-77bd-4174-b385-996fe75d0931 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1808 microversion: 2.20 time: 0.161364 Aug 25 05:18:25.194401 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 293/585] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:25 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:26.006312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:26.006917 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:26.013348 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:26.013890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:26.014325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:26.015006 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:26.015452 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:26.015875 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:26.140130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:26.148535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8524f99f-fb55-4bfe-b68d-722d6ff6a0bf tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.146703 Aug 25 05:18:26.149104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 293/586] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:26 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:26.216215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:26.216835 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:26.224070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:26.224577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:26.225446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:26.225694 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:26.226131 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:26.226539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:26.353636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:26.362194 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:26.364312 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:26.365459 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ce45e23c-bb83-45b9-827c-51af58b7f798 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1795 microversion: 2.20 time: 0.153082 Aug 25 05:18:26.366044 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 294/587] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:18:26 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1795 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:18:27.169369 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:27.170147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:27.177036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:27.177510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:27.177961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:27.178636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:27.179080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:27.179494 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:27.309985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:27.318259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2f5e4a8c-edfa-4740-a875-0052ed60a501 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.152770 Aug 25 05:18:27.318826 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 294/588] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:27 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:28.339731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:28.340339 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:28.343784 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=40 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:28.347315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:28.347787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:28.348797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:28.349522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:28.349990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:28.353128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:28.478619 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:28.487256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-00803e4a-ef71-4a90-b0e5-4d18ef7161fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.151368 Aug 25 05:18:28.487832 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 295/589] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:28 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:29.508045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:29.508643 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:29.515065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:29.515539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:29.515964 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:29.516641 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:29.517087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:29.517504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:29.645375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:29.653627 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-866d0ca0-de1a-4443-ae87-a32e895f5652 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.149410 Aug 25 05:18:29.654197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 295/590] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:29 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:30.675275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:30.675912 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:30.682334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:30.682804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:30.683225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:30.683897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:30.684339 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:30.684745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:30.808847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:30.817685 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6ed905dc-b627-47ad-8cfa-3aa07819a2f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.146208 Aug 25 05:18:30.818261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 296/591] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:30 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:31.838581 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:31.839178 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:31.845884 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:31.846357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:31.846781 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:31.847454 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:31.847899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:31.848310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:31.976925 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:31.985014 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9de42933-bca4-4c9f-9ff8-e3553d1ce4a8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.150260 Aug 25 05:18:31.985598 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 296/592] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:31 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:33.006995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:33.007655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:33.014053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:33.014521 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:33.014949 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:33.015623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:33.016063 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:33.016473 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:33.140738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:33.149468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1feac819-1053-44e9-b061-c491b8955977 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1734 microversion: 2.1 time: 0.146865 Aug 25 05:18:33.150060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 297/593] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:33 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:34.169949 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:34.170552 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:34.176816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.177319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.177792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.178466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.178909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.179322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.306647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:34.314743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-297b316d-da05-40e7-ac93-c5e5f90c7f22 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1714 microversion: 2.1 time: 0.148633 Aug 25 05:18:34.315308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 297/594] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:34 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:34.425365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:34.425877 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:34.432218 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.432697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.438246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.438246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.438246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.438246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.556982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] HTTP exception thrown: Cannot 'detach_volume' instance e79e79a1-46cc-437a-8c59-452ad20d1c13 while it is in vm_state rescued Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Request method failure captured: Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments/a3320577-6a62-4a61-9414-d808af57633b HTTP/1.1 Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUEnS3WKZ3AMTaTAOcloCHy3PDXGF5w46c4H_iBcA-z_zhXtqDR6hSX7ZnL03cySTyZg3pAWCLD2hcxzf-BHGb-up0NemC2sgcVWY1NNUxRtuBAwSupdG7m9UnVDWMyak1g2q_DpFMc7s7q93NeFrioU3j36FQWgTXGdm33A_jwA18 Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:18:34.558629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8afac3f36b8449aa8a25a376aa2c3ed9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: b6ca9962541744bf9d67cc3e05721413 Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:18:34.560206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Cannot 'detach_volume' instance e79e79a1-46cc-437a-8c59-452ad20d1c13 while it is in vm_state rescued Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'server_id': 'e79e79a1-46cc-437a-8c59-452ad20d1c13', 'id': 'a3320577-6a62-4a61-9414-d808af57633b'} Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e79e79a1-46cc-437a-8c59-452ad20d1c13 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:18:34.561058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e79e79a1-46cc-437a-8c59-452ad20d1c13 while it is in vm_state rescued Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e79e79a1-46cc-437a-8c59-452ad20d1c13 while it is in vm_state rescued Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:18:34.567879 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Returning 409 to user: Cannot 'detach_volume' instance e79e79a1-46cc-437a-8c59-452ad20d1c13 while it is in vm_state rescued {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:18:34.568930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3a4f932e-cb27-4258-960e-24e58f02ba62 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments/a3320577-6a62-4a61-9414-d808af57633b" status: 409 len: 152 microversion: 2.1 time: 0.138769 Aug 25 05:18:34.568930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 298/595] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:18:34 2022] DELETE /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments/a3320577-6a62-4a61-9414-d808af57633b => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 05:18:34.569919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:18:34.570453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:34.576359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.576840 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.577275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.577997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.578484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.578922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.794303 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ef446485-1644-4df1-95f3-6a1079d2b0eb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "POST /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/action" status: 202 len: 0 microversion: 2.1 time: 0.228813 Aug 25 05:18:34.795036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 298/596] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:18:34 2022] POST /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:18:34.804106 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:34.804722 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:34.810630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.812636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.812636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.812636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:34.812636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:34.813044 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:34.943570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:34.951907 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d9918401-ed1e-4338-929a-d3370eea8b6e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1722 microversion: 2.1 time: 0.152853 Aug 25 05:18:34.952475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 299/597] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:34 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:35.973803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:35.974492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:35.980547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:35.981028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:35.981458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:35.982165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:35.982610 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:35.983027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:36.059524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:18:36.059524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Thu Aug 25 05:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 (ip 10.222.0.16) !!! Aug 25 05:18:36.111099 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:36.119237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-18edc488-1a96-4712-9ade-f233c9c30d41 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1722 microversion: 2.1 time: 0.150487 Aug 25 05:18:36.119805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 299/598] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:35 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:37.140945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:37.141551 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:37.148659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:37.149131 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:37.149559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:37.150266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:37.150710 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:37.151125 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:37.284217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:37.293164 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b21a734c-be61-4e74-bdc0-6e934887be9a tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1722 microversion: 2.1 time: 0.156075 Aug 25 05:18:37.293754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 300/599] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:37 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:38.320688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:38.320688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:38.322093 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:38.322579 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:38.323003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:38.323683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:38.324156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:38.324572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:38.453011 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:38.455324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:38.461972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-920a9be8-76a1-4a99-81e7-8a7e09c3ffc8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1722 microversion: 2.1 time: 0.151627 Aug 25 05:18:38.466756 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 300/600] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:38 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:39.483300 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:39.483902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:39.490775 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:39.491249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:39.491677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:39.492388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:39.492836 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:39.493255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:39.622451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:18:39.631272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3d340a9f-4dba-4f9c-b1dd-2cde6fb9db24 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1728 microversion: 2.1 time: 0.151793 Aug 25 05:18:39.631839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 301/601] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:18:39 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:18:39.651616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:39.652136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:39.658781 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:39.659251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:39.659702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:39.660867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:39.661306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:39.661757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:39.740572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4854f1d6-20f2-4b65-8b4c-404de533882f tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093127 Aug 25 05:18:39.741180 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 301/602] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:18:39 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:18:40.853361 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-f3a94f45-895b-4b12-a91d-47e3e804b843 req-abc3316b-78c9-4b31-a316-2700aaa0e58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79e79a1-46cc-437a-8c59-452ad20d1c13", "tag": "dec7654a-e3e6-4b89-9a04-fa7592ccc30b"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:18:40.863582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f3a94f45-895b-4b12-a91d-47e3e804b843 req-abc3316b-78c9-4b31-a316-2700aaa0e58a service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:40.864197 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f3a94f45-895b-4b12-a91d-47e3e804b843 req-abc3316b-78c9-4b31-a316-2700aaa0e58a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:40.864713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f3a94f45-895b-4b12-a91d-47e3e804b843 req-abc3316b-78c9-4b31-a316-2700aaa0e58a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:40.876317 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-f3a94f45-895b-4b12-a91d-47e3e804b843 req-abc3316b-78c9-4b31-a316-2700aaa0e58a service nova] Creating event network-changed:dec7654a-e3e6-4b89-9a04-fa7592ccc30b for instance e79e79a1-46cc-437a-8c59-452ad20d1c13 on hv-cinder-85391 Aug 25 05:18:40.882929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-f3a94f45-895b-4b12-a91d-47e3e804b843 req-abc3316b-78c9-4b31-a316-2700aaa0e58a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033126 Aug 25 05:18:40.883605 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 302/603] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:18:42.897611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-e992cb04-57fa-487f-bb75-b0970acab977 req-8ff3a806-e711-44fc-a371-a54974fcc4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e79e79a1-46cc-437a-8c59-452ad20d1c13", "tag": "dec7654a-e3e6-4b89-9a04-fa7592ccc30b"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:18:42.906898 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e992cb04-57fa-487f-bb75-b0970acab977 req-8ff3a806-e711-44fc-a371-a54974fcc4ed service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:42.907367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e992cb04-57fa-487f-bb75-b0970acab977 req-8ff3a806-e711-44fc-a371-a54974fcc4ed service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:42.907789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e992cb04-57fa-487f-bb75-b0970acab977 req-8ff3a806-e711-44fc-a371-a54974fcc4ed service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:42.919046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-e992cb04-57fa-487f-bb75-b0970acab977 req-8ff3a806-e711-44fc-a371-a54974fcc4ed service nova] Creating event network-changed:dec7654a-e3e6-4b89-9a04-fa7592ccc30b for instance e79e79a1-46cc-437a-8c59-452ad20d1c13 on hv-cinder-85391 Aug 25 05:18:42.923890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-e992cb04-57fa-487f-bb75-b0970acab977 req-8ff3a806-e711-44fc-a371-a54974fcc4ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030517 Aug 25 05:18:42.924474 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 302/604] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:18:59.817916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:18:59.818381 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Thu Aug 25 05:18:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-volume_attachments/27278dcb-7ec2-46e7-911b-8a68c95383e6 (ip 10.222.0.16) !!! Aug 25 05:18:59.820023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=15 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:59.820745 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=85 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:18:59.928319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:18:59.928899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:18:59.935653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:59.936124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:59.936599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:18:59.937343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:18:59.937829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:18:59.938246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:00.017457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lazy-loading 'services' on Instance uuid cc100113-0ca3-4722-b59c-b725c79197cc {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:00.212906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a9e0c7c8-4e43-4052-9d40-2e74afb18921 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-volume_attachments/27278dcb-7ec2-46e7-911b-8a68c95383e6" status: 202 len: 0 microversion: 2.1 time: 0.396048 Aug 25 05:19:00.213497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 303/605] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:18:59 2022] DELETE /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-volume_attachments/27278dcb-7ec2-46e7-911b-8a68c95383e6 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:19:02.384405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=21 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:02.385146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=7 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:02.389232 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e8b3eb49-a8ba-404c-a1c3-2b4c2bee888c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:02.395490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8b3eb49-a8ba-404c-a1c3-2b4c2bee888c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:02.395962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8b3eb49-a8ba-404c-a1c3-2b4c2bee888c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:02.396386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e8b3eb49-a8ba-404c-a1c3-2b4c2bee888c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:02.457751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e8b3eb49-a8ba-404c-a1c3-2b4c2bee888c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Going to try to stop instance {{(pid=121310) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 05:19:02.821861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e8b3eb49-a8ba-404c-a1c3-2b4c2bee888c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action" status: 202 len: 0 microversion: 2.1 time: 0.438981 Aug 25 05:19:02.822483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 303/606] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:19:02 2022] POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:19:02.830964 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:02.835865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:02.838952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:02.839443 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:02.839875 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:02.840572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:02.841025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:02.841451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:02.969327 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:02.978215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b8d97876-cb52-4fd2-a28f-ead72a28c217 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.151393 Aug 25 05:19:02.982986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 304/607] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:02 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:03.999803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:04.000496 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:04.007272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:04.007741 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:04.008164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:04.008834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:04.009274 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:04.009714 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:04.136189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:04.143690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8e22dfa5-9f3e-40e3-a607-4b70fa12053f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.148530 Aug 25 05:19:04.144253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 304/608] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:03 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:05.164322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:05.164921 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:05.171317 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:05.171786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:05.172212 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:05.172884 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:05.173321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:05.173765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:05.304880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:05.312422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-74b7150e-5730-46a4-91d0-4afc738265f3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.151915 Aug 25 05:19:05.313002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 305/609] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:05 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:06.333905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:06.334538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:06.340976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:06.341452 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:06.341912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:06.342595 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:06.343041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:06.343458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:06.468897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:06.477426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bb889106-ce1f-4eb4-a841-b58ff221d31d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.147382 Aug 25 05:19:06.477962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 305/610] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:06 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:07.498686 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:07.499283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:07.506328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:07.512939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:07.512939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:07.512939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:07.512939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:07.513311 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:07.633987 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:07.641918 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fe53e05a-6bc1-432e-948e-011d63eafef7 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.147112 Aug 25 05:19:07.642488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 306/611] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:07 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:08.663322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:08.663920 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:08.670272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:08.670738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:08.671166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:08.671840 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:08.672302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:08.672712 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:08.799089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:08.807558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4c26dd5a-1b83-46d7-bac9-a18436907ea1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.148571 Aug 25 05:19:08.808125 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 306/612] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:08 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:09.361633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:09.361633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:09.366415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.366882 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.367304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.367983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.368426 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.368839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.391452 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ca91d917-0e76-4089-a462-0eec6ba07a44 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9/ips" status: 200 len: 150 microversion: 2.1 time: 0.132679 Aug 25 05:19:09.391996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 307/613] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:19:09 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9/ips => generated 150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:09.404960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d45e3d13-03f7-450e-ada4-c4a2341c4a19"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:09.407281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:09.413659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.414136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.414565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.415241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.415710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.416130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.493583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Invalid volume: volume d45e3d13-03f7-450e-ada4-c4a2341c4a19 is already attached to instances: 6a769edb-35d4-41ea-866f-3eb74f13e938 Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: POST /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9/os-volume_attachments HTTP/1.1 Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 74 Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:19:09.495305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {"volumeAttachment": {"volumeId": "d45e3d13-03f7-450e-ada4-c4a2341c4a19"}} Aug 25 05:19:09.496814 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Invalid volume: volume d45e3d13-03f7-450e-ada4-c4a2341c4a19 is already attached to instances: 6a769edb-35d4-41ea-866f-3eb74f13e938 Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'server_id': 'bcf9300a-25b9-43ef-929f-cdc1eb6542d9', 'body': {'volumeAttachment': {'volumeId': 'd45e3d13-03f7-450e-ada4-c4a2341c4a19'}}} Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d45e3d13-03f7-450e-ada4-c4a2341c4a19 is already attached to instances: 6a769edb-35d4-41ea-866f-3eb74f13e938 Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:09.497932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d45e3d13-03f7-450e-ada4-c4a2341c4a19 is already attached to instances: 6a769edb-35d4-41ea-866f-3eb74f13e938 Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:09.499321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d45e3d13-03f7-450e-ada4-c4a2341c4a19 is already attached to instances: 6a769edb-35d4-41ea-866f-3eb74f13e938 Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 400 to user: Invalid volume: volume d45e3d13-03f7-450e-ada4-c4a2341c4a19 is already attached to instances: 6a769edb-35d4-41ea-866f-3eb74f13e938 {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0e6f702a-1809-4395-8d3c-62b0f5d6d663 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095752 Aug 25 05:19:09.501038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 307/614] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:19:09 2022] POST /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:19:09.505661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:09.506149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:09.512055 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.512526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.512947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.513633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.514074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.514485 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.538712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:19:09.807153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-38be176f-5840-4bdc-8b78-c99610154696 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 204 len: 0 microversion: 2.1 time: 0.305155 Aug 25 05:19:09.807749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 308/615] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:19:09 2022] DELETE /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:19:09.816712 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:09.817397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:09.824435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.824911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.825335 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.826081 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.826489 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.826900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.828499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:09.829200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:09.835159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.835635 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.836059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.836771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:09.837210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:09.837650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:09.957824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:09.966084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-00ec96dc-3c1b-44bc-80d9-d72812c192bd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1683 microversion: 2.1 time: 0.153911 Aug 25 05:19:09.966500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 308/616] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:09 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:09.968578 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:09.977183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-68cea40c-1094-4509-ba30-d0c6c08af664 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.152974 Aug 25 05:19:09.977768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 309/617] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:09 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:10.988683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:10.989321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:10.995765 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:10.996236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:10.996663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:10.997367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:10.997857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:10.998273 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:11.003725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:11.004364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:11.010688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:11.011170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:11.011619 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:11.012282 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:11.012734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:11.013153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:11.131206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:11.138881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b46473f0-a8ae-4f0f-85a3-ed604edcc85f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1683 microversion: 2.1 time: 0.154721 Aug 25 05:19:11.139441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 309/618] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:10 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:11.142679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:11.150734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f3171cce-e6e6-4e58-a90e-ed6a77f46c62 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.150807 Aug 25 05:19:11.151289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 310/619] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:10 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:12.160381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:12.160979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:12.167477 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:12.171363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:12.171363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:12.171363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:12.171363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:12.171852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:12.172672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:12.173405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:12.180986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:12.181644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:12.182153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:12.183011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:12.183468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:12.183982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:12.315450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:12.326681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7ee3f1af-ae13-4898-8921-4640564f82bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.156868 Aug 25 05:19:12.326681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 311/620] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:12 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:12.359134 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:12.367561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-824386e7-f5ef-4b75-a689-fb6a7ede4c93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1683 microversion: 2.1 time: 0.210996 Aug 25 05:19:12.368226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 310/621] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:12 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:12.676655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-62838f89-cf61-43e4-8f94-18adbfb6a780 req-4777d8ee-b09e-4ebc-9971-a985a2458485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf9300a-25b9-43ef-929f-cdc1eb6542d9", "name": "network-vif-deleted", "tag": "f4ebc47f-9013-4fcf-a0a0-6d37bb85449a"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:12.687760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-62838f89-cf61-43e4-8f94-18adbfb6a780 req-4777d8ee-b09e-4ebc-9971-a985a2458485 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:12.688481 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-62838f89-cf61-43e4-8f94-18adbfb6a780 req-4777d8ee-b09e-4ebc-9971-a985a2458485 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:12.688898 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-62838f89-cf61-43e4-8f94-18adbfb6a780 req-4777d8ee-b09e-4ebc-9971-a985a2458485 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:12.704049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-62838f89-cf61-43e4-8f94-18adbfb6a780 req-4777d8ee-b09e-4ebc-9971-a985a2458485 service nova] Creating event network-vif-deleted:f4ebc47f-9013-4fcf-a0a0-6d37bb85449a for instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 on hv-cinder-85391 Aug 25 05:19:12.709619 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-62838f89-cf61-43e4-8f94-18adbfb6a780 req-4777d8ee-b09e-4ebc-9971-a985a2458485 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092410 Aug 25 05:19:12.710392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 312/622] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:13.347135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:13.347755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:13.354898 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:13.355388 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:13.355813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:13.356508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:13.357185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:13.357634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:13.390932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:13.395917 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:13.404359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:13.404840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:13.405264 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:13.408637 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:13.409535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:13.410292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:13.456029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:13.456501 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:13.456925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:13.457373 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lazy-loading 'fault' on Instance uuid bcf9300a-25b9-43ef-929f-cdc1eb6542d9 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:13.509022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:13.526580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3925e321-03c5-42c0-8cb3-b5a3dbe3a70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 200 len: 1332 microversion: 2.1 time: 0.141617 Aug 25 05:19:13.527001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:13.527713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 313/623] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:13 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:13.536306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-97b7d9dd-6646-43ab-bf9c-a855b20a7f6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1679 microversion: 2.1 time: 0.193927 Aug 25 05:19:13.550742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 311/624] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:13 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1679 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:14.547979 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:14.548428 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:14.555227 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:14.555707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:14.556137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:14.556833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:14.557283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:14.557723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:14.558345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:14.558946 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:14.565007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:14.566113 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:14.566538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:14.567222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:14.567838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:14.568251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:14.572284 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 HTTP/1.1 Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:19:14.573963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:19:14.575277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'bcf9300a-25b9-43ef-929f-cdc1eb6542d9'} Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:19:14.576007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:19:14.577208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:14.578331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:19:14.579132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-06210214-9290-4392-9705-e94ab7c94421 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 404 len: 111 microversion: 2.1 time: 0.035154 Aug 25 05:19:14.579962 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 314/625] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:14 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:19:14.588643 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ef775b5c-04b0-484a-9eec-706d988acdb8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '.version_select at 0x7f2423cf3e50>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:14.671163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ef775b5c-04b0-484a-9eec-706d988acdb8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540564945" status: 202 len: 0 microversion: 2.1 time: 0.086599 Aug 25 05:19:14.671751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 315/626] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Aug 25 05:19:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540564945 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:19:14.728955 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:14.736764 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0d54c162-54db-408d-a819-e050ef6793f0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1656 microversion: 2.1 time: 0.182195 Aug 25 05:19:14.738017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 312/627] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:14 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1656 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:14.757869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fc1c8bb0-d8d6-4710-beb2-ae67672206e6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:14.764573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc1c8bb0-d8d6-4710-beb2-ae67672206e6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:14.765089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc1c8bb0-d8d6-4710-beb2-ae67672206e6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:14.765476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc1c8bb0-d8d6-4710-beb2-ae67672206e6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:14.788344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fc1c8bb0-d8d6-4710-beb2-ae67672206e6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Going to try to start instance {{(pid=121314) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 05:19:15.005266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fc1c8bb0-d8d6-4710-beb2-ae67672206e6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action" status: 202 len: 0 microversion: 2.1 time: 0.251172 Aug 25 05:19:15.005907 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 316/628] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:19:14 2022] POST /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:19:15.018372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:15.018372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:15.020941 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:15.021426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:15.021896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:15.022615 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:15.023091 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:15.023487 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:15.154133 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:15.164209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2972e9e6-79ca-4135-808e-7d973346ed11 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1665 microversion: 2.1 time: 0.153890 Aug 25 05:19:15.165307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 313/629] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:15 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:15.551870 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:15.552455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:15.559684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:15.560165 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:15.560596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:15.561288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:15.561769 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:15.562195 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:15.646839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lazy-loading 'services' on Instance uuid 6a769edb-35d4-41ea-866f-3eb74f13e938 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:15.772525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:15.886622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-248b8f4b-638f-4ea6-acb3-1886b3273ea9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments/d45e3d13-03f7-450e-ada4-c4a2341c4a19" status: 202 len: 0 microversion: 2.1 time: 0.339490 Aug 25 05:19:15.887386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 317/630] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:19:15 2022] DELETE /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments/d45e3d13-03f7-450e-ada4-c4a2341c4a19 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:19:15.896473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:15.899110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:15.907070 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:15.907683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:15.908203 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:15.909541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:15.910184 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:15.910610 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:15.941036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1a6cfa05-8b2a-49dc-9625-9bfbb9c155c0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049201 Aug 25 05:19:15.941618 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 314/631] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:19:15 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:16.186997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:16.188504 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:16.194463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:16.194934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:16.195356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:16.196029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:16.196466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:16.196875 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:16.325523 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:16.333097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a72b357d-bdc8-4512-b665-1cfd34e3fa26 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1665 microversion: 2.1 time: 0.150322 Aug 25 05:19:16.333682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 318/632] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:16 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:16.953616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:16.955789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:16.962339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:16.962820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:16.963251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:16.963926 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:16.964372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:16.964790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:16.994757 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-53b049c0-85f9-4ece-acb5-b48fbd14a597 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Aug 25 05:19:16.995311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 315/633] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:19:16 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:17.354374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:17.354976 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:17.361094 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:17.361620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:17.362123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:17.362799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:17.363464 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:17.363885 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:17.494310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:17.502097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e39bd00a-b744-4b42-9c8d-4b76bcbcb2a8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1669 microversion: 2.1 time: 0.151992 Aug 25 05:19:17.503151 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 319/634] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:17 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:18.007299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:18.009484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:18.015924 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:18.022912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:18.022912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:18.022912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:18.022912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:18.023252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:18.046879 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-727eb65e-7519-4f6d-8033-70cceb9fc70e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 25 05:19:18.047539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 316/635] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:19:18 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:19.059749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:19.062061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:19.068819 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:19.069287 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:19.069736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:19.070406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:19.070844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:19.071251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:19.099696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1c516340-0ce0-4e35-8a5d-c18c620566d3 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043863 Aug 25 05:19:19.100231 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 320/636] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:19:19 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:19:19.160249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:19.160771 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:19.167076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:19.167549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:19.167980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:19.168661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:19.169107 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:19.169524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:19.194344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:19:19.221717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:19.527118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-716cc2dc-1559-466d-8bf2-5ce480760057 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 204 len: 0 microversion: 2.1 time: 0.370426 Aug 25 05:19:19.527702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 317/637] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:19:19 2022] DELETE /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:19:19.535779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:19.537146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:19.542514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:19.542982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:19.543404 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:19.544074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:19.544512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:19.544921 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:19.673397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:19.681488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9d082d8b-7d77-4bfb-b726-12b5f87001ae tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1681 microversion: 2.1 time: 0.149560 Aug 25 05:19:19.682072 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 321/638] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:19 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:20.703661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:20.704372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:20.710775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:20.711241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:20.711661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:20.712334 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:20.712773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:20.713183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:20.841438 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:20.849855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c051b25a-9a35-4eed-9347-ee32fb12ebf1 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1681 microversion: 2.1 time: 0.150421 Aug 25 05:19:20.850410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 318/639] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:20 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:21.871433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:21.872135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:21.879559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:21.880033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:21.880456 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:21.881138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:21.881576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:21.882011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:22.010214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:22.017911 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a9fd531f-ceed-4fdb-a8ec-a96edd6a9067 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1681 microversion: 2.1 time: 0.150327 Aug 25 05:19:22.018787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 322/640] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:21 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:22.462833 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-4beff00a-fffd-4398-bcb7-cfd598f525c9 req-6b4141b1-98b5-40b0-84e3-6e14a3d5d128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a769edb-35d4-41ea-866f-3eb74f13e938", "name": "network-vif-deleted", "tag": "998258dc-63e3-42e3-b67d-ae2e1b94e7e8"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:22.474255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4beff00a-fffd-4398-bcb7-cfd598f525c9 req-6b4141b1-98b5-40b0-84e3-6e14a3d5d128 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:22.475507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4beff00a-fffd-4398-bcb7-cfd598f525c9 req-6b4141b1-98b5-40b0-84e3-6e14a3d5d128 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:22.475507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4beff00a-fffd-4398-bcb7-cfd598f525c9 req-6b4141b1-98b5-40b0-84e3-6e14a3d5d128 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:22.486954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-4beff00a-fffd-4398-bcb7-cfd598f525c9 req-6b4141b1-98b5-40b0-84e3-6e14a3d5d128 service nova] Creating event network-vif-deleted:998258dc-63e3-42e3-b67d-ae2e1b94e7e8 for instance 6a769edb-35d4-41ea-866f-3eb74f13e938 on hv-cinder-85391 Aug 25 05:19:22.492112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-4beff00a-fffd-4398-bcb7-cfd598f525c9 req-6b4141b1-98b5-40b0-84e3-6e14a3d5d128 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033273 Aug 25 05:19:22.492734 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 319/641] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:23.039905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:23.040603 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:23.046761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:23.047321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:23.047827 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:23.048603 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:23.049136 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:23.050185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:23.082644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:23.083127 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:23.083557 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:23.084006 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lazy-loading 'fault' on Instance uuid 6a769edb-35d4-41ea-866f-3eb74f13e938 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:23.128334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:23.136104 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1058b165-9c4a-46ad-b7ed-e9d0ecc24afd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 200 len: 1332 microversion: 2.1 time: 0.100553 Aug 25 05:19:23.136670 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 323/642] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:23 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:24.158634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:24.159397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:24.165526 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:24.166035 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:24.166470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:24.167150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:24.167596 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:24.168012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:24.181330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 HTTP/1.1 Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:19:24.182952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:19:24.184458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '6a769edb-35d4-41ea-866f-3eb74f13e938'} Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:19:24.185314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:19:24.186697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:19:24.187950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:19:24.187950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-19b5cd66-f6bd-4eb1-b0a1-57368a64081d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 404 len: 111 microversion: 2.1 time: 0.030469 Aug 25 05:19:24.187950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 320/643] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:24 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:19:24.193793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8494c89e-9282-469c-b314-abe07c1e6b37 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '.version_select at 0x7f2423cf31f0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:24.276737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8494c89e-9282-469c-b314-abe07c1e6b37 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956276812" status: 202 len: 0 microversion: 2.1 time: 0.087337 Aug 25 05:19:24.277320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 324/644] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Aug 25 05:19:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956276812 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:19:25.017574 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-beebc410-21d9-4e9f-aee0-9598c1b77789 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: .version_select at 0x7f2423b9dc10>, body: {"keypair": {"name": "tempest-keypair-1103978130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsG//YiMt8H7zoFMmrzUle2TqUosufncKJRrxJnTyLdsNDL2OTq8XEJ+OJH9sX7gu+4qeYjIepHy6BVMUMfyBqvJdnWeTSjSlOL70X4u/9v2fa9YI1Rfm9mvZnjTLbnXA=="}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:25.032750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-beebc410-21d9-4e9f-aee0-9598c1b77789 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:19:25.037199 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-beebc410-21d9-4e9f-aee0-9598c1b77789 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:19:25.099728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-beebc410-21d9-4e9f-aee0-9598c1b77789 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086007 Aug 25 05:19:25.100318 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 321/645] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:19:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:25.315844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:25.316338 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:25.323450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:25.323925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:25.324354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:25.325136 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:25.325631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:25.326052 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:25.354435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b6f964b8-0e5a-49ed-91a5-b2e3bfb25b1d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments/cb73f2e0-7eca-49c4-90d5-dcf7dacb2d4e" status: 200 len: 194 microversion: 2.20 time: 0.142357 Aug 25 05:19:25.355018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 325/646] 10.222.0.16 () {60 vars in 1454 bytes} [Thu Aug 25 05:19:25 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments/cb73f2e0-7eca-49c4-90d5-dcf7dacb2d4e => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:19:25.424446 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:25.424962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:25.431794 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:25.432221 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:25.432652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:25.433335 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:25.433836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:25.434256 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:25.557147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lazy-loading 'services' on Instance uuid 070a4cc0-c2a7-4e19-b265-7c540dc6f045 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:25.806612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-44ee8ec8-6684-49de-bedc-eb0bd27c3cab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments/cb73f2e0-7eca-49c4-90d5-dcf7dacb2d4e" status: 202 len: 0 microversion: 2.20 time: 0.386523 Aug 25 05:19:25.807293 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 322/647] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Aug 25 05:19:25 2022] DELETE /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments/cb73f2e0-7eca-49c4-90d5-dcf7dacb2d4e => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:19:25.817623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:25.820134 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:25.826061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:25.826532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:25.826960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:25.827683 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:25.828119 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:25.828526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:25.857755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a97c6b55-ac28-40de-8e85-c561a5c5b3b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045291 Aug 25 05:19:25.858360 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 326/648] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Aug 25 05:19:25 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:19:26.870813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:26.873197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:26.879979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:26.880451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:26.880899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:26.881625 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:26.882256 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:26.882580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:26.912961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-873828c4-c27d-4ed3-9e14-01bc862ab74d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047161 Aug 25 05:19:26.913518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 323/649] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Aug 25 05:19:26 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:19:27.331220 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-597064851", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f1da36-d799-4803-8568-258dd71a0604"}], "security_groups": [{"name": "tempest-securitygroup--702005207"}], "key_name": "tempest-keypair-1103978130", "user_data": "}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:27.432206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] validate_networks() for [('68f1da36-d799-4803-8568-258dd71a0604', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:19:27.844360 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:19:27.844801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:19:27.845529 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:19:27.845953 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:19:27.846358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:19:27.854999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:27.855465 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:27.855906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:27.856607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:27.857050 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:27.857463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:27.874255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:19:27.878769 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:19:27.889814 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:19:27.892048 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:19:27.926092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:27.928239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:27.934686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:27.935166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:27.935601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:27.936312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:27.936752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:27.937172 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:27.965688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ebe0d291-1e9a-41b8-ba34-0ebe30011026 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044249 Aug 25 05:19:27.966247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 324/650] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Aug 25 05:19:27 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:27.987162 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b818a86b-5f99-480e-a354-321b42a68b4f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.659757 Aug 25 05:19:27.988169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 327/651] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:19:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:19:27.998553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2c6d4309-806a-48bc-bb2e-8ee928818701 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:27.999163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2c6d4309-806a-48bc-bb2e-8ee928818701 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:28.036812 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:28.037508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:28.045046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:28.045570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:28.046028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:28.046713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:28.047149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:28.047561 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:28.067903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2c6d4309-806a-48bc-bb2e-8ee928818701 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:28.075630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:19:28.075822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2c6d4309-806a-48bc-bb2e-8ee928818701 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1241 microversion: 2.1 time: 0.081054 Aug 25 05:19:28.076381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 325/652] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:27 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:28.344253 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8825f1c8-d3bb-4118-9394-d40872fbdb63 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 204 len: 0 microversion: 2.20 time: 0.311443 Aug 25 05:19:28.345224 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 328/653] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Aug 25 05:19:28 2022] DELETE /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 05:19:28.353799 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:28.355531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:28.360282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:28.360756 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:28.361189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:28.362647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:28.363091 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:28.363509 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:28.497550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:28.505786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:28.510219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:28.510219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-79cf22f7-231b-4be1-b1d5-90bb52d35cdc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.158521 Aug 25 05:19:28.510219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 326/654] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:28 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:29.096809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:29.097961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:29.104066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:29.104542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:29.104969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:29.105700 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:29.106143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:29.106553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:29.168840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:29.176457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c8a3351a-7c5c-46a6-be9a-b6f7c9853ee5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1245 microversion: 2.1 time: 0.084245 Aug 25 05:19:29.177027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 329/655] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:29 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:29.531449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:29.532056 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:29.538496 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:29.538966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:29.539391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:29.540067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:29.540508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:29.540923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:29.665194 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:29.673234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:29.674761 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:29.675929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-75bb7a55-379a-48c4-9632-28122e71b130 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.148472 Aug 25 05:19:29.676480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 327/656] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:29 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:30.197127 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:30.197737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:30.200261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:30.205075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:30.205556 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:30.206016 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:30.206706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:30.207153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:30.207576 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:30.272155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:30.279788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a2fcdb22-18b5-4237-9a54-af396f65dd21 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1237 microversion: 2.1 time: 0.086534 Aug 25 05:19:30.280346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 330/657] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:30 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:30.699777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:30.700591 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:30.707069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:30.707548 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:30.707976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:30.708657 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:30.709102 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:30.709524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:30.962161 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:30.971128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:30.973178 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:30.984216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dbc828a3-748e-408e-b7bc-3a0b64b059b7 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1723 microversion: 2.20 time: 0.278547 Aug 25 05:19:30.984216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 328/658] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:30 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:31.302255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:31.303454 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:31.330688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:31.334998 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:31.335766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:31.336680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:31.338133 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:31.338715 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:31.445060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:31.471801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8b4f30e2-01f9-4d8c-b428-c0bae8ba66a4 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1301 microversion: 2.1 time: 0.174870 Aug 25 05:19:31.485065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 331/659] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:31 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1301 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:31.506996 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-7dbf93f6-b2fb-4407-8b41-2b1b364bf11e req-b956ab2a-291e-4b67-8784-76ec3c692673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070a4cc0-c2a7-4e19-b265-7c540dc6f045", "name": "network-vif-deleted", "tag": "918a320b-9189-42f8-9052-24cef6e0d004"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:31.518700 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7dbf93f6-b2fb-4407-8b41-2b1b364bf11e req-b956ab2a-291e-4b67-8784-76ec3c692673 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:31.519222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7dbf93f6-b2fb-4407-8b41-2b1b364bf11e req-b956ab2a-291e-4b67-8784-76ec3c692673 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:31.519654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7dbf93f6-b2fb-4407-8b41-2b1b364bf11e req-b956ab2a-291e-4b67-8784-76ec3c692673 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:31.535864 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-7dbf93f6-b2fb-4407-8b41-2b1b364bf11e req-b956ab2a-291e-4b67-8784-76ec3c692673 service nova] Creating event network-vif-deleted:918a320b-9189-42f8-9052-24cef6e0d004 for instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 on hv-cinder-85391 Aug 25 05:19:31.541090 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-7dbf93f6-b2fb-4407-8b41-2b1b364bf11e req-b956ab2a-291e-4b67-8784-76ec3c692673 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038252 Aug 25 05:19:31.541719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 329/660] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:31.997249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:31.997875 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:32.005840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:32.006316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:32.006747 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:32.007433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:32.007872 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:32.008471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:32.112646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:32.122600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:32.124294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:32.125697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-edd639a7-b1c1-4d10-a319-3e081cfdd2db tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 200 len: 1366 microversion: 2.20 time: 0.132347 Aug 25 05:19:32.126578 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 332/661] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:31 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:32.493743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:32.500908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:32.500908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:32.502734 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:32.503357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:32.503931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:32.504703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:32.505296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:32.505821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:32.649760 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:32.658130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ccd16abf-6286-41c9-9fd7-c7d2b783be8e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1366 microversion: 2.1 time: 0.168828 Aug 25 05:19:32.668747 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 330/662] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:32 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:33.149880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:33.150415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:33.156592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:33.157068 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:33.160677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:33.160677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:33.160677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:33.160677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:33.172798 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] HTTP exception thrown: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Request method failure captured: Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 HTTP/1.1 Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUHCyCEYol1yUOU-FkmvG7vXjEnQGgpaoOK8_c6S9BqCGBgY88B9iKx_kuiGeV3JgdXOclwGu-mNieGZNtxSf686l_HgYIEWnZ-OEX3tb4LomuVOY9iQCUQB5UUW7FynGy7HFB8GoKXRmxENCtrEknPV9E0kgFGSSZOsttpFfZHxeQ Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:19:33.174476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcd7d2bdaffb4d168f27cf6444e005dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 3326fcf3ccbc4a978e9e52e25456ad98 Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:19:33.176554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '070a4cc0-c2a7-4e19-b265-7c540dc6f045'} Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:19:33.177362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:19:33.178691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:33.179904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Returning 404 to user: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:19:33.179904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c62c7314-9c2c-4d8b-b400-c88d9aa7cf2f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 404 len: 111 microversion: 2.20 time: 0.030742 Aug 25 05:19:33.179904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 333/663] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:33 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:19:33.191747 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e1bc5b98-a30b-4b59-bfa8-59e7fab434e9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '.version_select at 0x7f2423caef70>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:33.265140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e1bc5b98-a30b-4b59-bfa8-59e7fab434e9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-572337935" status: 204 len: 0 microversion: 2.20 time: 0.078396 Aug 25 05:19:33.265763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 331/664] 10.222.0.16 () {60 vars in 1259 bytes} [Thu Aug 25 05:19:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-572337935 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:19:33.344343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-5b154b1f-4331-41c1-ba9a-48911d2ca806 req-476e5872-07fe-452b-b323-b1260b773c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940baae4-f323-4807-87d4-f556d88e3e8f", "tag": "2545757e-3565-43ac-8647-9693f02cbdb1"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:33.355046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-5b154b1f-4331-41c1-ba9a-48911d2ca806 req-476e5872-07fe-452b-b323-b1260b773c73 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:33.355825 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-5b154b1f-4331-41c1-ba9a-48911d2ca806 req-476e5872-07fe-452b-b323-b1260b773c73 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:33.356251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-5b154b1f-4331-41c1-ba9a-48911d2ca806 req-476e5872-07fe-452b-b323-b1260b773c73 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:33.368995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-5b154b1f-4331-41c1-ba9a-48911d2ca806 req-476e5872-07fe-452b-b323-b1260b773c73 service nova] Creating event network-changed:2545757e-3565-43ac-8647-9693f02cbdb1 for instance 940baae4-f323-4807-87d4-f556d88e3e8f on hv-cinder-85391 Aug 25 05:19:33.374225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-5b154b1f-4331-41c1-ba9a-48911d2ca806 req-476e5872-07fe-452b-b323-b1260b773c73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094312 Aug 25 05:19:33.374817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 334/665] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:33.684883 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:33.685988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:33.696620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:33.697239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:33.699327 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:33.701086 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:33.701703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:33.702233 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:33.897203 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:33.904803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f69a6e83-edc8-476e-bd1e-93a91c45d7ca tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1366 microversion: 2.1 time: 0.227395 Aug 25 05:19:33.905403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 332/666] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:33 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:34.120850 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fd892037-c5e5-49a2-9293-dbd47b7063af tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'create', calling method: .version_select at 0x7f2423abaca0>, body: {"keypair": {"name": "tempest-keypair-1694814463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArVWnp8k+J9jXRYK/+kdM81x3hegNobq2Pk87Gt934CLK5+hMo2pNdsDy6/ya7RJIYp7hfMJMR8lsCEdURTC+DviAr5JTVnnpQNXvmL/uW0sEr2XWMq4N8Tx0QXMZwqyA=="}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:34.136453 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-fd892037-c5e5-49a2-9293-dbd47b7063af tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:19:34.140239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-fd892037-c5e5-49a2-9293-dbd47b7063af tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for user 3326fcf3ccbc4a978e9e52e25456ad98 and project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:19:34.236944 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fd892037-c5e5-49a2-9293-dbd47b7063af tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.120261 Aug 25 05:19:34.237762 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 335/667] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Aug 25 05:19:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 05:19:34.927560 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:34.928168 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:34.934322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:34.934799 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:34.935227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:34.935914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:34.936366 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:34.936787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:35.080479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:35.088310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6db276dc-842e-48a7-8312-eaeae7ac99fd tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1366 microversion: 2.1 time: 0.165947 Aug 25 05:19:35.088882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 333/668] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:34 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:36.110407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:36.111142 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:36.118548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:36.119052 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:36.119671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:36.120360 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:36.120821 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:36.121243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:36.141269 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:36.288325 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:36.295968 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6ba3c97c-9f9e-46e8-8747-959c02cbd3ec tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1366 microversion: 2.1 time: 0.190025 Aug 25 05:19:36.296574 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 336/669] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:36 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:36.730128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1907206998", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2acaae5e-ff29-4076-80e0-d2cd629fe935"}], "security_groups": [{"name": "tempest-securitygroup--1756870071"}], "key_name": "tempest-keypair-1694814463", "user_data": "}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:36.833507 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] validate_networks() for [('2acaae5e-ff29-4076-80e0-d2cd629fe935', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:19:37.078085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:37.078644 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:37.087279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.087910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.088489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.089357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.089945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.090471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.180770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lazy-loading 'services' on Instance uuid e79e79a1-46cc-437a-8c59-452ad20d1c13 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:37.280481 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:19:37.280893 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:19:37.281354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:19:37.281790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:19:37.282190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:19:37.290920 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.291387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.291853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.292561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.293003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.293414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.309969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:19:37.315134 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Getting quotas for user 3326fcf3ccbc4a978e9e52e25456ad98 and project dcd7d2bdaffb4d168f27cf6444e005dd. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:19:37.327096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:19:37.329480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:19:37.523940 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1b7325d3-6b49-4aa1-aebe-2689cd0f40fa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.798103 Aug 25 05:19:37.524607 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 334/670] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Aug 25 05:19:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 25 05:19:37.529068 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:37.529692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:37.536322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.536794 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.537214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.537985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.538424 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.538838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.573086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-33b1abb3-64a1-4063-bd07-7230b4dd655b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments/a3320577-6a62-4a61-9414-d808af57633b" status: 202 len: 0 microversion: 2.1 time: 0.499376 Aug 25 05:19:37.576269 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 337/671] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:19:37 2022] DELETE /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments/a3320577-6a62-4a61-9414-d808af57633b => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:19:37.578883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6885b99a-c65e-4737-ad7b-e373a5cb8286 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:37.579636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6885b99a-c65e-4737-ad7b-e373a5cb8286 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:37.634714 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6885b99a-c65e-4737-ad7b-e373a5cb8286 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:37.642231 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6885b99a-c65e-4737-ad7b-e373a5cb8286 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:37.643733 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6885b99a-c65e-4737-ad7b-e373a5cb8286 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:37.644890 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6885b99a-c65e-4737-ad7b-e373a5cb8286 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1282 microversion: 2.20 time: 0.070125 Aug 25 05:19:37.645439 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 338/672] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:37 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:37.651152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:37.653768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:37.660833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.661406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.661903 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.664392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:37.664848 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:37.665271 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:37.694414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:37.698582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4cbc9008-c906-4ab4-b0ba-0f2a59e01087 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050958 Aug 25 05:19:37.699167 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 339/673] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:19:37 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:37.707174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c77bdebf-706a-4df1-a025-c8f4c79de6d9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1366 microversion: 2.1 time: 0.181007 Aug 25 05:19:37.707910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 335/674] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:37 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:37.997709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:38.053930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-f207dc55-2412-490e-b726-2f026080e0b4 req-87f41a21-d0c4-47df-a9f8-73e1af1a73e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940baae4-f323-4807-87d4-f556d88e3e8f", "name": "network-vif-plugged", "status": "completed", "tag": "2545757e-3565-43ac-8647-9693f02cbdb1"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:38.063757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f207dc55-2412-490e-b726-2f026080e0b4 req-87f41a21-d0c4-47df-a9f8-73e1af1a73e2 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:38.064298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f207dc55-2412-490e-b726-2f026080e0b4 req-87f41a21-d0c4-47df-a9f8-73e1af1a73e2 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:38.064761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-f207dc55-2412-490e-b726-2f026080e0b4 req-87f41a21-d0c4-47df-a9f8-73e1af1a73e2 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:38.076274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-f207dc55-2412-490e-b726-2f026080e0b4 req-87f41a21-d0c4-47df-a9f8-73e1af1a73e2 service nova] Creating event network-vif-plugged:2545757e-3565-43ac-8647-9693f02cbdb1 for instance 940baae4-f323-4807-87d4-f556d88e3e8f on hv-cinder-85391 Aug 25 05:19:38.081091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-f207dc55-2412-490e-b726-2f026080e0b4 req-87f41a21-d0c4-47df-a9f8-73e1af1a73e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090471 Aug 25 05:19:38.082329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 340/675] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:38.668237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:38.668951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:38.676073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:38.676548 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:38.676975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:38.677680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:38.678129 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:38.678544 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:38.714085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:38.716610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:38.724169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:38.724946 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:38.725553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:38.726430 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:38.727085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:38.727507 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:38.760127 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-738b5fe4-f3ec-4033-aa4c-7e39558be3f6 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051385 Aug 25 05:19:38.763435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 341/676] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:19:38 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:38.766723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:38.767782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:38.768041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:38.774734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:38.775429 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:38.776150 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:38.776992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:38.777604 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:38.778197 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:38.780773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:38.782375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:38.783461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d6994873-1f01-4b59-941b-bf43e1460182 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1286 microversion: 2.20 time: 0.119791 Aug 25 05:19:38.786158 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 336/677] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:38 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1286 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:38.923334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:38.931112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b6e05573-a08f-4207-b41d-4756ee4a55dc tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1366 microversion: 2.1 time: 0.168840 Aug 25 05:19:38.931688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 342/678] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:38 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:39.773154 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:39.775397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:39.781317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.781835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.782266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:39.782936 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.783377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.783789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:39.812200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-51fe753b-67a9-4f07-b704-2208f4b431f7 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043700 Aug 25 05:19:39.812743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 337/679] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:19:39 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:19:39.814119 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:39.814721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:39.822029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.822565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.822932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:39.823638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.824098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.824515 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:39.919869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:39.920402 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:39.927482 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.927707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.928368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:39.928845 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.929500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.930105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:39.933751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:39.942622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:39.944128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:39.945377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1d17b51d-3be0-48df-a32a-75783a9e2fde tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1278 microversion: 2.20 time: 0.135206 Aug 25 05:19:39.946304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 343/680] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:39 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:19:39.955110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:39.965107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:39.965107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:39.968270 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:19:39.971185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.971667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.972660 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:39.973353 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:39.973853 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:39.974300 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:40.158806 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:40.168354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-467eedef-7ff0-4e36-b8ea-93e07e2c3aaf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1366 microversion: 2.1 time: 0.209335 Aug 25 05:19:40.168976 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 344/681] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:39 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:40.304473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-86d8cac3-db0e-44c1-81a7-0c81dc6b7aa8 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 204 len: 0 microversion: 2.1 time: 0.388404 Aug 25 05:19:40.305071 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 338/682] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:19:39 2022] DELETE /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:19:40.313083 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:40.313721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:40.319651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:40.320120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:40.320543 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:40.321211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:40.321681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:40.322094 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:40.453028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:40.461148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6c01e1c9-d18f-4c85-964f-12b1f3fa2027 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1688 microversion: 2.1 time: 0.151835 Aug 25 05:19:40.461737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 345/683] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:40 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:40.973736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:40.974450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:40.980906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:40.981414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:40.981942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:40.982618 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:40.983061 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:40.983475 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:41.046417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:41.054654 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:41.056233 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:41.057314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c580a72f-5730-48ab-a4e3-e8aa6c87d394 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1334 microversion: 2.20 time: 0.088194 Aug 25 05:19:41.057905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 339/684] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:40 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:41.189484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:41.190143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:41.197244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:41.197688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:41.198115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:41.198795 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:41.199238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:41.199654 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:41.327342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:41.334966 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-105b8883-6da1-46b6-baa6-c12414d16c53 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1556 microversion: 2.1 time: 0.149357 Aug 25 05:19:41.335532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 346/685] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:41 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:41.355160 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:41.355638 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:41.361522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:41.362022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:41.362948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:41.363620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:41.364061 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:41.364471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:41.441679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e55f06f2-faa4-4b0d-b5d0-b52d446d84d0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089601 Aug 25 05:19:41.442272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 340/686] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:19:41 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:41.483006 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:41.483611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:41.490158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:41.490636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:41.491063 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:41.491746 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:41.492189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:41.492606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:41.623818 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:41.631603 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e29f6185-8c38-4943-9aed-3096c38f776e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1688 microversion: 2.1 time: 0.152444 Aug 25 05:19:41.632168 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 347/687] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:41 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:42.083488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:42.084003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:42.089959 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:42.091027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:42.091453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:42.092135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:42.092577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:42.092995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:42.169165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:42.177699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:42.179385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:42.180501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ffc701cf-3eec-4f8d-a77a-d39762f6c82f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1334 microversion: 2.20 time: 0.101488 Aug 25 05:19:42.181055 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 341/688] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:42 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:42.430365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-43935554-378e-4523-8c97-437a5e5cd4ea req-d242831d-af02-4770-ae4c-94f5de6f1548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940baae4-f323-4807-87d4-f556d88e3e8f", "tag": "2545757e-3565-43ac-8647-9693f02cbdb1"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:42.440082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-43935554-378e-4523-8c97-437a5e5cd4ea req-d242831d-af02-4770-ae4c-94f5de6f1548 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:42.440561 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-43935554-378e-4523-8c97-437a5e5cd4ea req-d242831d-af02-4770-ae4c-94f5de6f1548 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:42.440984 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-43935554-378e-4523-8c97-437a5e5cd4ea req-d242831d-af02-4770-ae4c-94f5de6f1548 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:42.452024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-43935554-378e-4523-8c97-437a5e5cd4ea req-d242831d-af02-4770-ae4c-94f5de6f1548 service nova] Creating event network-changed:2545757e-3565-43ac-8647-9693f02cbdb1 for instance 940baae4-f323-4807-87d4-f556d88e3e8f on hv-cinder-85391 Aug 25 05:19:42.456731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-43935554-378e-4523-8c97-437a5e5cd4ea req-d242831d-af02-4770-ae4c-94f5de6f1548 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030125 Aug 25 05:19:42.457300 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 348/689] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:42.652400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:42.652925 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:42.658799 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:42.659348 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:42.660319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:42.661008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:42.661459 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:42.661912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:42.791266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:42.799189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a443db96-ff9d-4774-9911-a0ac8ff054cb tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1688 microversion: 2.1 time: 0.150699 Aug 25 05:19:42.799784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 342/690] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:42 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:43.204329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:43.205063 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:43.211923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:43.212407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:43.212839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:43.213534 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:43.214014 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:43.214437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:43.280377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:43.288607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:43.290140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:43.291225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f5e217ad-6ff4-4abe-bb07-3e340f8e6895 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1334 microversion: 2.20 time: 0.091379 Aug 25 05:19:43.291782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 349/691] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:43 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:43.820895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:43.821512 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:43.827899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:43.828373 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:43.828800 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:43.829476 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:43.829939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:43.830350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:43.959384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:43.967027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6fb71e79-5cfa-49f4-be22-c9be936ec1a0 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1688 microversion: 2.1 time: 0.150023 Aug 25 05:19:43.967578 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 343/692] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:43 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:44.313457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:44.314086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:44.321202 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:44.321848 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:44.322281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:44.322973 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:44.323420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:44.323838 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:44.384821 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:44.393638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:44.395133 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:44.396326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c5d6b4c3-7a85-46ff-9f8b-b56200ba0ea8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1334 microversion: 2.20 time: 0.086863 Aug 25 05:19:44.396869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 350/693] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:44 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:44.988502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:44.989909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:44.998060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:44.998796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:44.999564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:45.000420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:45.001012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:45.001614 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:45.418851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:45.419717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:45.426754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:45.427343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:45.427858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:45.429447 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:45.430126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:45.430555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:45.494221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:45.502806 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:45.504791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:45.505908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-215d9eab-ace0-4547-9e60-f29781c6819d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1340 microversion: 2.20 time: 0.091123 Aug 25 05:19:45.506469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 351/694] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:45 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:19:45.608456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:45.616741 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cbce202e-2ef7-4aec-89fa-79d06b2a05aa tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1688 microversion: 2.1 time: 0.632298 Aug 25 05:19:45.617522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 344/695] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:44 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1688 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:46.303469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-d3f46f42-4e51-4a7e-8846-025efcd9d62b req-6e724a11-2cef-42c7-96b8-d5e3d9f56a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e79e79a1-46cc-437a-8c59-452ad20d1c13", "name": "network-vif-deleted", "tag": "dec7654a-e3e6-4b89-9a04-fa7592ccc30b"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:46.321173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-d3f46f42-4e51-4a7e-8846-025efcd9d62b req-6e724a11-2cef-42c7-96b8-d5e3d9f56a67 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:46.321173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-d3f46f42-4e51-4a7e-8846-025efcd9d62b req-6e724a11-2cef-42c7-96b8-d5e3d9f56a67 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:46.321173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-d3f46f42-4e51-4a7e-8846-025efcd9d62b req-6e724a11-2cef-42c7-96b8-d5e3d9f56a67 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:46.333702 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-d3f46f42-4e51-4a7e-8846-025efcd9d62b req-6e724a11-2cef-42c7-96b8-d5e3d9f56a67 service nova] Creating event network-vif-deleted:dec7654a-e3e6-4b89-9a04-fa7592ccc30b for instance e79e79a1-46cc-437a-8c59-452ad20d1c13 on hv-cinder-85391 Aug 25 05:19:46.339634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-d3f46f42-4e51-4a7e-8846-025efcd9d62b req-6e724a11-2cef-42c7-96b8-d5e3d9f56a67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041066 Aug 25 05:19:46.344278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 352/696] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:46.540430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:46.540430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:46.540430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:46.540430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:46.541183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:46.541183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:46.541183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:46.541183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:46.640512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:46.642618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:46.662614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:46.663602 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:46.664270 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:46.665204 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:46.665917 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:46.666582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:46.709723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:46.710660 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:46.711276 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:46.711876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lazy-loading 'fault' on Instance uuid e79e79a1-46cc-437a-8c59-452ad20d1c13 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:46.756751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:46.766156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2ee4692c-59f6-4a53-aeb3-00d85b53d285 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 200 len: 1335 microversion: 2.1 time: 0.131062 Aug 25 05:19:46.766797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 353/697] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:46 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 1335 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:46.876924 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:46.886538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:46.888334 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:46.889770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7911872f-0e3b-41f6-8f57-a9625a8c25ce tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.364839 Aug 25 05:19:46.905013 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 345/698] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:46 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:47.788474 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:47.791221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: e79e79a1-46cc-437a-8c59-452ad20d1c13] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:47.793606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=12 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:47.805024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:47.806933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:47.807686 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:47.808547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:47.809042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:47.809472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:47.825638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] HTTP exception thrown: Instance e79e79a1-46cc-437a-8c59-452ad20d1c13 could not be found. Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Request method failure captured: Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 HTTP/1.1 Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUEnS3WKZ3AMTaTAOcloCHy3PDXGF5w46c4H_iBcA-z_zhXtqDR6hSX7ZnL03cySTyZg3pAWCLD2hcxzf-BHGb-up0NemC2sgcVWY1NNUxRtuBAwSupdG7m9UnVDWMyak1g2q_DpFMc7s7q93NeFrioU3j36FQWgTXGdm33A_jwA18 Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:19:47.827446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8afac3f36b8449aa8a25a376aa2c3ed9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: b6ca9962541744bf9d67cc3e05721413 Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance e79e79a1-46cc-437a-8c59-452ad20d1c13 could not be found. Aug 25 05:19:47.828990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'e79e79a1-46cc-437a-8c59-452ad20d1c13'} Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e79e79a1-46cc-437a-8c59-452ad20d1c13 could not be found. Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:19:47.829864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e79e79a1-46cc-437a-8c59-452ad20d1c13 could not be found. Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e79e79a1-46cc-437a-8c59-452ad20d1c13 could not be found. Aug 25 05:19:47.832086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:47.834292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Returning 404 to user: Instance e79e79a1-46cc-437a-8c59-452ad20d1c13 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:19:47.834292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-64eb4f53-6982-4be6-b5fa-1a201c3c086e tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13" status: 404 len: 111 microversion: 2.1 time: 0.044305 Aug 25 05:19:47.834292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 354/699] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:47 2022] GET /compute/v2.1/servers/e79e79a1-46cc-437a-8c59-452ad20d1c13 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:19:47.838567 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dc2d83bc-8d23-432d-8188-3314a1e090fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '.version_select at 0x7f2423a83a60>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:47.845947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:47.847125 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=12 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:47.912637 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:47.913236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:47.919751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:47.920265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:47.920786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:47.921455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:47.921918 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:47.922327 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:47.933775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dc2d83bc-8d23-432d-8188-3314a1e090fd tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462648714" status: 202 len: 0 microversion: 2.1 time: 0.099460 Aug 25 05:19:47.939761 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 346/700] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Aug 25 05:19:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462648714 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:19:48.115399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:48.118896 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:48.123980 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:48.125510 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:48.126638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-077dc5ef-cf23-45b0-a189-f027147e61b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.218012 Aug 25 05:19:48.127201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 355/701] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:47 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:19:48.363182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-b1678071-ad61-4c04-80df-c2cc75a2261d req-caeffdc8-7307-418e-8daa-867f22ea2dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c73035-4140-417b-b820-a1f7ce16e591", "tag": "734e6925-ff8f-414a-b2c5-79868183c1ba"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:48.375325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-b1678071-ad61-4c04-80df-c2cc75a2261d req-caeffdc8-7307-418e-8daa-867f22ea2dc9 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:48.375886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-b1678071-ad61-4c04-80df-c2cc75a2261d req-caeffdc8-7307-418e-8daa-867f22ea2dc9 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:48.376379 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-b1678071-ad61-4c04-80df-c2cc75a2261d req-caeffdc8-7307-418e-8daa-867f22ea2dc9 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:48.387295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-b1678071-ad61-4c04-80df-c2cc75a2261d req-caeffdc8-7307-418e-8daa-867f22ea2dc9 service nova] Creating event network-changed:734e6925-ff8f-414a-b2c5-79868183c1ba for instance 15c73035-4140-417b-b820-a1f7ce16e591 on hv-cinder-85391 Aug 25 05:19:48.392044 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-b1678071-ad61-4c04-80df-c2cc75a2261d req-caeffdc8-7307-418e-8daa-867f22ea2dc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033861 Aug 25 05:19:48.392652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 347/702] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:49.150215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:49.150852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:49.158002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:49.158533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:49.158966 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:49.159652 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:49.160098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:49.160518 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:49.288332 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:49.299535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:49.299535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:49.299535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f6d61aa6-16f8-47f9-8183-6baa7f1b8b6e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.152778 Aug 25 05:19:49.300070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 356/703] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:49 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:50.321924 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:50.322615 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:50.330253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:50.330763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:50.331694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:50.332385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:50.332830 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:50.333249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:50.549674 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:50.558473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:50.560010 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:50.561353 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2eff8445-1e21-408c-b2a5-82731d0afec2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.243640 Aug 25 05:19:50.577790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 348/704] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:50 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:51.357013 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:51.357509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:51.363934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:51.364410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:51.364836 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:51.365514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:51.365990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:51.366411 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:51.390709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:19:51.586230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:51.586761 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:51.593265 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:51.593787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:51.594216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:51.594902 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:51.595626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:51.596045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:51.715394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f5d5f015-f525-4905-8eb8-a9b905212a59 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 204 len: 0 microversion: 2.1 time: 0.361946 Aug 25 05:19:51.715992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 357/705] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:19:51 2022] DELETE /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:19:51.725308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:51.725725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:51.726037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:51.731989 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:51.732467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:51.732889 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:51.733566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:51.734040 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:51.734155 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:51.734456 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:51.735575 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:51.736664 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a9a50c80-ed4a-4e33-aea3-3d07e56ea164 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.156176 Aug 25 05:19:51.737221 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 349/706] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:51 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:51.871575 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:51.879887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-44747026-d2eb-4512-9b33-bf5c6538ee99 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1506 microversion: 2.1 time: 0.159517 Aug 25 05:19:51.880463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 358/707] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:51 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:52.040716 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-8e60ba4f-c80a-4902-98c5-a86a6dbe20fe req-95b68605-c8f9-46e2-9f07-6e950e1fa35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c73035-4140-417b-b820-a1f7ce16e591", "name": "network-vif-plugged", "status": "completed", "tag": "734e6925-ff8f-414a-b2c5-79868183c1ba"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:52.050450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-8e60ba4f-c80a-4902-98c5-a86a6dbe20fe req-95b68605-c8f9-46e2-9f07-6e950e1fa35a service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:52.050923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-8e60ba4f-c80a-4902-98c5-a86a6dbe20fe req-95b68605-c8f9-46e2-9f07-6e950e1fa35a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:52.051353 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-8e60ba4f-c80a-4902-98c5-a86a6dbe20fe req-95b68605-c8f9-46e2-9f07-6e950e1fa35a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:52.062069 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-8e60ba4f-c80a-4902-98c5-a86a6dbe20fe req-95b68605-c8f9-46e2-9f07-6e950e1fa35a service nova] Creating event network-vif-plugged:734e6925-ff8f-414a-b2c5-79868183c1ba for instance 15c73035-4140-417b-b820-a1f7ce16e591 on hv-cinder-85391 Aug 25 05:19:52.066717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-8e60ba4f-c80a-4902-98c5-a86a6dbe20fe req-95b68605-c8f9-46e2-9f07-6e950e1fa35a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029652 Aug 25 05:19:52.067287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 350/708] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:52.760479 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:52.761026 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:52.767463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:52.767942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:52.768370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:52.769042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:52.769485 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:52.769931 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:52.896748 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:52.901952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:52.918251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:52.918846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:52.918846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:52.918846 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-276a27ad-8f8d-4ead-920d-efcd2d631086 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.151474 Aug 25 05:19:52.919128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 359/709] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:52 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:52.919209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:52.919209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:52.919209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:52.919209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:52.919492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:52.919492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:53.042429 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:53.051070 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d6970492-a573-47bc-bf11-a280b087d517 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1506 microversion: 2.1 time: 0.154417 Aug 25 05:19:53.051648 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 351/710] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:52 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:53.930589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:53.931230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:53.937519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:53.938029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:53.938448 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:53.939118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:53.939556 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:53.939964 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:54.069168 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:54.071795 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:54.072486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:54.077694 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:54.079079 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:54.079209 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:54.079502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:54.079934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:54.080283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ecf7a999-b7ad-4cc0-9974-cff381000c4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.153583 Aug 25 05:19:54.080652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:54.082136 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 360/711] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:53 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:54.082292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:54.082292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:54.209152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:54.216702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9aab52eb-3f49-464c-8db4-255b94dbb235 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1506 microversion: 2.1 time: 0.148824 Aug 25 05:19:54.217264 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 352/712] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:54 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:55.004190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-da8df340-acb2-4118-8160-a8e6c18785d8 req-fc6063cd-8bbb-4515-83ed-030cd835ead5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00679982-187d-430a-908f-29644650feb4", "name": "network-vif-deleted", "tag": "f5a8bbe4-e926-4999-b1e8-599f495bd711"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:55.014027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-da8df340-acb2-4118-8160-a8e6c18785d8 req-fc6063cd-8bbb-4515-83ed-030cd835ead5 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:55.014494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-da8df340-acb2-4118-8160-a8e6c18785d8 req-fc6063cd-8bbb-4515-83ed-030cd835ead5 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:55.014915 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-da8df340-acb2-4118-8160-a8e6c18785d8 req-fc6063cd-8bbb-4515-83ed-030cd835ead5 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:55.028412 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-da8df340-acb2-4118-8160-a8e6c18785d8 req-fc6063cd-8bbb-4515-83ed-030cd835ead5 service nova] Creating event network-vif-deleted:f5a8bbe4-e926-4999-b1e8-599f495bd711 for instance 00679982-187d-430a-908f-29644650feb4 on hv-cinder-85391 Aug 25 05:19:55.033217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-da8df340-acb2-4118-8160-a8e6c18785d8 req-fc6063cd-8bbb-4515-83ed-030cd835ead5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033165 Aug 25 05:19:55.033777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 361/713] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:19:55.103240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:55.103851 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:55.110494 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:55.111002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:55.111457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:55.112143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:55.112625 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:55.113127 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:55.239387 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:55.240077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:55.242886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:55.246390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:55.246941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:55.247951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:55.248173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:55.248680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:55.249100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:55.251849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:55.253375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:55.254501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3cc3689c-3b98-447b-8cca-6ef322dce2eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1408 microversion: 2.20 time: 0.155199 Aug 25 05:19:55.255053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 353/714] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:55 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:55.313768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:55.322101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-69ec974b-3489-4ca5-96a9-34de1bddc777 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1464 microversion: 2.1 time: 0.087335 Aug 25 05:19:55.322955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 362/715] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:55 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:56.277316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:56.277937 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:56.284893 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:56.285364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:56.285813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:56.286491 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:56.286929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:56.287341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:56.343419 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:56.344018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:56.351288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:56.351768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:56.352199 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:56.355675 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:56.355675 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:56.355675 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:56.384755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:56.385157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:56.385581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:56.386062 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lazy-loading 'fault' on Instance uuid 00679982-187d-430a-908f-29644650feb4 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:19:56.427301 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:56.432842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:56.441780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:56.441780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:56.441780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c2b781bd-af32-4a56-91b4-999f861ad7c2 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1601 microversion: 2.20 time: 0.165490 Aug 25 05:19:56.442156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 354/716] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:19:56 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:19:56.442251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ecadfd81-9d82-4a98-8835-7eb9eb8fbc96 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 200 len: 1311 microversion: 2.1 time: 0.101927 Aug 25 05:19:56.442251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 363/717] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:56 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:19:56.464447 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:56.464447 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:56.467564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:56.468032 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:56.468453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:56.469133 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:56.469577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:56.470021 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:56.548020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bfc36363-abe2-4342-bb8e-ed487a47a70c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090695 Aug 25 05:19:56.548613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 355/718] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Aug 25 05:19:56 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 05:19:57.462719 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:57.463331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: 00679982-187d-430a-908f-29644650feb4] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:57.469675 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:57.470158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:57.470843 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:57.471749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:57.472205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:57.472626 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:57.486126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] HTTP exception thrown: Instance 00679982-187d-430a-908f-29644650feb4 could not be found. Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Request method failure captured: Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 HTTP/1.1 Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUEnS3WKZ3AMTaTAOcloCHy3PDXGF5w46c4H_iBcA-z_zhXtqDR6hSX7ZnL03cySTyZg3pAWCLD2hcxzf-BHGb-up0NemC2sgcVWY1NNUxRtuBAwSupdG7m9UnVDWMyak1g2q_DpFMc7s7q93NeFrioU3j36FQWgTXGdm33A_jwA18 Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:19:57.487750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8afac3f36b8449aa8a25a376aa2c3ed9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: b6ca9962541744bf9d67cc3e05721413 Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 00679982-187d-430a-908f-29644650feb4 could not be found. Aug 25 05:19:57.489266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '00679982-187d-430a-908f-29644650feb4'} Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00679982-187d-430a-908f-29644650feb4 could not be found. Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:19:57.490359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00679982-187d-430a-908f-29644650feb4 could not be found. Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00679982-187d-430a-908f-29644650feb4 could not be found. Aug 25 05:19:57.491517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:19:57.493230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Returning 404 to user: Instance 00679982-187d-430a-908f-29644650feb4 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:19:57.493230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-78045382-0808-4122-97cb-acaf459d2742 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4" status: 404 len: 111 microversion: 2.1 time: 0.030326 Aug 25 05:19:57.493230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 364/719] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:57 2022] GET /compute/v2.1/servers/00679982-187d-430a-908f-29644650feb4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:19:57.498292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:57.498913 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:57.505332 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:57.505859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:57.506298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:57.506986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:57.507459 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:57.507889 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:57.530770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:19:57.538629 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:19:57.785057 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-7f290eba-48ee-41fd-888c-b7c1f1d2ffe2 req-fd1f6b3b-c40f-47a7-a868-3f3259a73972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c73035-4140-417b-b820-a1f7ce16e591", "tag": "734e6925-ff8f-414a-b2c5-79868183c1ba"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:19:57.794214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-7f290eba-48ee-41fd-888c-b7c1f1d2ffe2 req-fd1f6b3b-c40f-47a7-a868-3f3259a73972 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:57.794677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-7f290eba-48ee-41fd-888c-b7c1f1d2ffe2 req-fd1f6b3b-c40f-47a7-a868-3f3259a73972 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:57.795263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-7f290eba-48ee-41fd-888c-b7c1f1d2ffe2 req-fd1f6b3b-c40f-47a7-a868-3f3259a73972 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:57.808735 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-7f290eba-48ee-41fd-888c-b7c1f1d2ffe2 req-fd1f6b3b-c40f-47a7-a868-3f3259a73972 service nova] Creating event network-changed:734e6925-ff8f-414a-b2c5-79868183c1ba for instance 15c73035-4140-417b-b820-a1f7ce16e591 on hv-cinder-85391 Aug 25 05:19:57.813665 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-7f290eba-48ee-41fd-888c-b7c1f1d2ffe2 req-fd1f6b3b-c40f-47a7-a868-3f3259a73972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032285 Aug 25 05:19:57.814259 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 365/720] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:19:57.915576 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ce98152e-8aa9-44a9-953f-2c7e10d15747 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "DELETE /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 204 len: 0 microversion: 2.1 time: 0.421322 Aug 25 05:19:57.918275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 356/721] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:19:57 2022] DELETE /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:19:57.925902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:57.926857 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:57.933149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:57.933701 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:57.934137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:57.935019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:57.935498 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:57.935923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:58.072730 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:58.081086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-07df21cf-f741-446d-99af-a06b8eee67de tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.160110 Aug 25 05:19:58.081689 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 366/722] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:57 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:19:59.103141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:19:59.103752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:19:59.110236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:59.110710 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:59.111137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:59.111817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:19:59.112900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:19:59.113317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:19:59.239674 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:19:59.247385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b350002d-3f53-442a-8713-dfad1c57fa4b tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.148558 Aug 25 05:19:59.247951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 357/723] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:19:59 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:00.267397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:00.267955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:00.275149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:00.275619 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:00.276043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:00.276714 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:00.277156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:00.277570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:00.408815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:00.416780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-16702db8-2e57-4679-adf1-17fcd15b75a5 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1522 microversion: 2.1 time: 0.153325 Aug 25 05:20:00.417346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 367/724] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:00 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:01.059904 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-35024454-fe22-4489-ab9f-b864d9c55715 req-8baa7a06-0517-426f-826c-d30e7ea1de29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3a8721-5c5c-411a-85f9-8ee33510ccb6", "name": "network-vif-deleted", "tag": "89194eae-54f6-4cb6-81a1-0443f90b1835"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:20:01.070893 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-35024454-fe22-4489-ab9f-b864d9c55715 req-8baa7a06-0517-426f-826c-d30e7ea1de29 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:01.071365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-35024454-fe22-4489-ab9f-b864d9c55715 req-8baa7a06-0517-426f-826c-d30e7ea1de29 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:01.071792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-35024454-fe22-4489-ab9f-b864d9c55715 req-8baa7a06-0517-426f-826c-d30e7ea1de29 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:01.083264 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-35024454-fe22-4489-ab9f-b864d9c55715 req-8baa7a06-0517-426f-826c-d30e7ea1de29 service nova] Creating event network-vif-deleted:89194eae-54f6-4cb6-81a1-0443f90b1835 for instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 on hv-cinder-85391 Aug 25 05:20:01.088744 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-35024454-fe22-4489-ab9f-b864d9c55715 req-8baa7a06-0517-426f-826c-d30e7ea1de29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032466 Aug 25 05:20:01.090042 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 358/725] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:20:01.437783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:01.445135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:01.446312 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:01.446865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:01.447295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:01.448127 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:01.448713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:01.449149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:01.477422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:01.482522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:01.482994 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:01.483418 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:01.483852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lazy-loading 'fault' on Instance uuid da3a8721-5c5c-411a-85f9-8ee33510ccb6 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:20:01.524799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca9962541744bf9d67cc3e05721413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afac3f36b8449aa8a25a376aa2c3ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:01.532836 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0022abeb-2d9d-4dd3-8a1a-942474ac1264 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 200 len: 1312 microversion: 2.1 time: 0.099011 Aug 25 05:20:01.533684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 368/726] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:01 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:02.554852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:02.555464 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] [instance: da3a8721-5c5c-411a-85f9-8ee33510ccb6] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:02.562096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:02.562573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:02.563003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:02.563691 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:02.564137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:02.564557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:02.577959 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] HTTP exception thrown: Instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 could not be found. Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Request method failure captured: Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 HTTP/1.1 Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUEnS3WKZ3AMTaTAOcloCHy3PDXGF5w46c4H_iBcA-z_zhXtqDR6hSX7ZnL03cySTyZg3pAWCLD2hcxzf-BHGb-up0NemC2sgcVWY1NNUxRtuBAwSupdG7m9UnVDWMyak1g2q_DpFMc7s7q93NeFrioU3j36FQWgTXGdm33A_jwA18 Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:20:02.579536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8afac3f36b8449aa8a25a376aa2c3ed9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8afac3f36b8449aa8a25a376aa2c3ed9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 8afac3f36b8449aa8a25a376aa2c3ed9 Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1935471506 Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: b6ca9962541744bf9d67cc3e05721413 Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1935471506-project Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 could not be found. Aug 25 05:20:02.581505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': 'da3a8721-5c5c-411a-85f9-8ee33510ccb6'} Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 could not be found. Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:20:02.582283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 could not be found. Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 could not be found. Aug 25 05:20:02.583751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:20:02.584981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] Returning 404 to user: Instance da3a8721-5c5c-411a-85f9-8ee33510ccb6 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:20:02.584981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9fa59d52-0769-44dd-bd64-490e5d385253 tempest-ServerRescueNegativeTestJSON-1935471506 tempest-ServerRescueNegativeTestJSON-1935471506-project] 10.222.0.16 "GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6" status: 404 len: 111 microversion: 2.1 time: 0.030425 Aug 25 05:20:02.584981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 359/727] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:02 2022] GET /compute/v2.1/servers/da3a8721-5c5c-411a-85f9-8ee33510ccb6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:20:22.971639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:22.976309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:22.976309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:22.981450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:22.981955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:22.982388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:22.983075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:22.983533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:22.983943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:23.014807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9ffcef71-8f95-4af8-91c0-5f40e1de7dd0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047601 Aug 25 05:20:23.015355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 369/728] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:20:22 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:20:23.075206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:23.075694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:23.077868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:23.078510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:23.083378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:23.083853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:23.084275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:23.084952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:23.085391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:23.085846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:23.110979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:20:23.434818 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ba786ea5-2e2a-4cbe-a7b6-f71e9c220ec3 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 204 len: 0 microversion: 2.1 time: 0.363197 Aug 25 05:20:23.435405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 360/729] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:20:23 2022] DELETE /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:20:23.444786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:23.445395 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:23.451872 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:23.452350 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:23.452778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:23.453457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:23.453938 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:23.454487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:23.592998 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:23.600731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4fbcd0c0-5dea-49b1-8a60-34e6882b22f8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1675 microversion: 2.1 time: 0.161046 Aug 25 05:20:23.601280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 370/730] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:23 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:24.621893 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:24.622593 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:24.629377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:24.629909 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:24.630337 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:24.631020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:24.631983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:24.632398 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:24.759589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:24.767189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-983c269c-3e4c-4f2e-9f94-f316752bbaf0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1675 microversion: 2.1 time: 0.149516 Aug 25 05:20:24.767748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 361/731] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:24 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:25.718741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-77b50b94-c100-4e23-b4b3-63408cd4fb9e req-e6e0f5da-fb61-4d58-b64b-76c9a40b51d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc100113-0ca3-4722-b59c-b725c79197cc", "name": "network-vif-deleted", "tag": "49fe036d-972f-4829-a56e-3949f17aa88a"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:20:25.730082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-77b50b94-c100-4e23-b4b3-63408cd4fb9e req-e6e0f5da-fb61-4d58-b64b-76c9a40b51d2 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:25.730548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-77b50b94-c100-4e23-b4b3-63408cd4fb9e req-e6e0f5da-fb61-4d58-b64b-76c9a40b51d2 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:25.731029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-77b50b94-c100-4e23-b4b3-63408cd4fb9e req-e6e0f5da-fb61-4d58-b64b-76c9a40b51d2 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:25.742339 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-77b50b94-c100-4e23-b4b3-63408cd4fb9e req-e6e0f5da-fb61-4d58-b64b-76c9a40b51d2 service nova] Creating event network-vif-deleted:49fe036d-972f-4829-a56e-3949f17aa88a for instance cc100113-0ca3-4722-b59c-b725c79197cc on hv-cinder-85391 Aug 25 05:20:25.747488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-77b50b94-c100-4e23-b4b3-63408cd4fb9e req-e6e0f5da-fb61-4d58-b64b-76c9a40b51d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Aug 25 05:20:25.748388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 371/732] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:20:25.789290 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:25.789960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:25.797226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:25.797742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:25.798168 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:25.799063 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:25.799509 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:25.799921 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:25.875216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:25.885681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-315646f1-5649-4e99-a74e-6b2a78546b5b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 200 len: 1607 microversion: 2.1 time: 0.100889 Aug 25 05:20:25.886280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 362/733] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:25 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 1607 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:26.907096 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:26.907821 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:26.914511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:26.914991 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:26.915422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:26.916111 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:26.916559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:26.916984 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:26.930384 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] HTTP exception thrown: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Request method failure captured: Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc HTTP/1.1 Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUIarOXh0xAUZnLyeqBisf2u12WIZq7qE4awO6B3Xs-DghRO8QbrsSiXVw2TFPXd5UupGQglehTwIrt6Zxx3EabjU1ScyugIrb_8pegFkkZ7Yi_lScHNgF9rsE3yOcakyWAhDJT-nyomaXar64JX-I8Tu_lnoiuaj2at6UJiicouXk Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:20:26.932109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2eb9cdd7b67546ca8eb089247f0a0ce1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: d61cf1670a7a43519c7258cd467227b6 Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:20:26.933865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'cc100113-0ca3-4722-b59c-b725c79197cc'} Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:20:26.934656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:20:26.936319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:20:26.937988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Returning 404 to user: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:20:26.937988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6f5dd391-87f9-4438-9bca-2468db67670c tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 404 len: 111 microversion: 2.1 time: 0.031060 Aug 25 05:20:26.938329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 372/734] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:26 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:20:26.942966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-72fe2951-57d2-4b5a-acba-f00d187e2fee tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '.version_select at 0x7f2423a9b310>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:27.025349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-72fe2951-57d2-4b5a-acba-f00d187e2fee tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-194603556" status: 202 len: 0 microversion: 2.1 time: 0.086118 Aug 25 05:20:27.025983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 363/735] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Aug 25 05:20:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-194603556 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:20:27.822671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-65e9b66c-366c-49eb-966b-e991aafb42c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'create', calling method: .version_select at 0x7f2423a670d0>, body: {"keypair": {"name": "tempest-keypair-491294545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzXNOmugDhqqgZG8MqPPuIgNpEYd2NAHPb/7e5l7OpZbRwpXE3X/wP0iXcaj3Wp7l9sNP2wkOWyU6Ign1oPvtgGZUj1+aKjLmJbNR3M5RfdPknnKlJ7I9S+hao7v1gILg=="}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:20:27.838457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-65e9b66c-366c-49eb-966b-e991aafb42c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:20:27.842265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-65e9b66c-366c-49eb-966b-e991aafb42c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for user d61cf1670a7a43519c7258cd467227b6 and project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:20:27.945454 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-65e9b66c-366c-49eb-966b-e991aafb42c4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127404 Aug 25 05:20:27.946122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 373/736] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:20:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:20:30.715591 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-569509236", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28953a19-c976-4328-9ac9-ee52893446db"}], "security_groups": [{"name": "tempest-securitygroup--859620898"}], "key_name": "tempest-keypair-491294545", "user_data": "}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:20:30.817929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] validate_networks() for [('28953a19-c976-4328-9ac9-ee52893446db', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:20:31.435172 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:20:31.435584 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:20:31.436044 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:20:31.436441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:20:31.436844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:20:31.446185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:31.446657 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:31.455508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:31.455508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:31.455508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:31.455508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:31.466177 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:20:31.470229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Getting quotas for user d61cf1670a7a43519c7258cd467227b6 and project 2eb9cdd7b67546ca8eb089247f0a0ce1. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:20:31.481656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:20:31.483987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:20:31.603034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a950f02d-9347-4b91-bb5f-8b46c1b6b0ac tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.893319 Aug 25 05:20:31.603674 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 364/737] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:20:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:20:31.614951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1e39e262-5544-4269-a7d8-7a98325f9199 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:31.615556 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1e39e262-5544-4269-a7d8-7a98325f9199 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:31.685364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1e39e262-5544-4269-a7d8-7a98325f9199 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:31.685364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1e39e262-5544-4269-a7d8-7a98325f9199 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1236 microversion: 2.1 time: 0.072518 Aug 25 05:20:31.685364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 374/738] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:31 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:32.704816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:32.705432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:32.711821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:32.712350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:32.712781 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:32.713458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:32.714038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:32.714409 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:32.778370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:32.785973 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6d9cf227-b8c6-4cf7-9e83-ce39f8a9925b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1240 microversion: 2.1 time: 0.085599 Aug 25 05:20:32.786552 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 365/739] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:32 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:33.806647 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:33.807211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:33.814016 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:33.814732 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:33.819088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:33.819088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:33.819088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:33.819088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:33.881033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:33.889255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-08df8154-22fb-4dc3-a3c8-6e968feed3e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1296 microversion: 2.1 time: 0.086663 Aug 25 05:20:33.890076 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 375/740] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:33 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:34.911224 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:34.912676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:34.920277 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:34.920755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:34.921396 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:34.922272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:34.922718 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:34.923471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:35.149300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:35.157364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a3dbc5c1-865c-4031-9c6b-650b037ef826 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.250459 Aug 25 05:20:35.157969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 366/741] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:34 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:20:35.657018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-88550ccc-01f4-4687-8820-5fa21d6e0f87 req-62e8d468-2a7d-4f59-b23f-1e885008e9cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0e0019-4497-4587-9bda-8b2f158a8863", "tag": "65bf2c10-1959-4066-8f1f-777c8aeea327"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:20:35.669535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-88550ccc-01f4-4687-8820-5fa21d6e0f87 req-62e8d468-2a7d-4f59-b23f-1e885008e9cd service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:35.670087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-88550ccc-01f4-4687-8820-5fa21d6e0f87 req-62e8d468-2a7d-4f59-b23f-1e885008e9cd service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:35.670579 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-88550ccc-01f4-4687-8820-5fa21d6e0f87 req-62e8d468-2a7d-4f59-b23f-1e885008e9cd service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:35.682602 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-88550ccc-01f4-4687-8820-5fa21d6e0f87 req-62e8d468-2a7d-4f59-b23f-1e885008e9cd service nova] Creating event network-changed:65bf2c10-1959-4066-8f1f-777c8aeea327 for instance 6e0e0019-4497-4587-9bda-8b2f158a8863 on hv-cinder-85391 Aug 25 05:20:35.687770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-88550ccc-01f4-4687-8820-5fa21d6e0f87 req-62e8d468-2a7d-4f59-b23f-1e885008e9cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034555 Aug 25 05:20:35.688779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 376/742] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:20:36.178796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:36.179378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:36.185702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:36.186165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:36.186606 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:36.187376 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:36.187816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:36.188228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:36.396187 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:36.404339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7fab9e88-9de6-4683-b228-757af4afe5c8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.229435 Aug 25 05:20:36.405002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 367/743] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:36 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:37.425678 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:37.426386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:37.433122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:37.433628 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:37.434065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:37.434752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:37.435202 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:37.435623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:37.573309 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:37.580850 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8e4cbf83-6a04-4084-b4db-46f9e776371d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.159449 Aug 25 05:20:37.581448 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 377/744] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:37 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:38.601631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:38.602181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:38.608503 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:38.608970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:38.609392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:38.610156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:38.610601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:38.611013 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:38.737888 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:38.745434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cb47a168-32ec-49bc-aebe-20cefcf393cb tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.147852 Aug 25 05:20:38.746023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 368/745] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:38 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:39.766319 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:39.766920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:39.773354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:39.773863 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:39.774290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:39.774963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:39.775407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:39.775817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:39.901089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:39.908956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5e42070e-53de-4b35-bf31-3340ec155d48 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.146471 Aug 25 05:20:39.909519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 378/746] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:39 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:40.943680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:40.944317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:40.950203 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:40.950674 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:40.951097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:40.951815 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:40.952258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:40.952671 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:41.081465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:41.089204 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a3c3a32a-6c97-49a5-9c97-10b3a8c3a600 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.149535 Aug 25 05:20:41.089800 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 369/747] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:40 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:42.110398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:42.110932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:42.113311 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=6 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:42.118808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:42.120916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:42.120916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:42.120916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:42.120916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:42.121251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:42.252593 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:42.260471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e75ae261-be85-4b22-b8d5-bfc996c09c1e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.153952 Aug 25 05:20:42.261044 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 379/748] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:42 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:43.281806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:43.282404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:43.284394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:43.285046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=6 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:43.290625 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:43.291104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:43.291528 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:43.292202 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:43.292643 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:43.293056 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:43.421157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:43.428666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e904bd80-8d3c-47bc-8611-06a759fa2c74 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.150771 Aug 25 05:20:43.429226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 370/749] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:43 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:44.448727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:44.449328 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:44.455830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:44.456300 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:44.456725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:44.457397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:44.457878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:44.458290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:44.584829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:44.592464 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-eeafa708-16d5-4e47-946e-25ebbda1d48b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.148144 Aug 25 05:20:44.598205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 380/750] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:44 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:45.613384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:45.613978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:45.620496 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:45.620976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:45.621410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:45.622124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:45.622577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:45.622995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:45.749010 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:45.756462 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a1a3952a-1ca4-4298-9622-92f7f6f165ab tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.147124 Aug 25 05:20:45.757066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 371/751] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:45 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:46.776559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:46.777157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:46.783897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:46.784382 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:46.784809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:46.785491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:46.786030 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:46.786497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:46.916558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:46.924383 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e9f110b9-c0a0-4375-86a5-826de222d9c6 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.151708 Aug 25 05:20:46.924947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 381/752] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:46 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:20:47.944266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:47.954412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:47.954412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:47.954412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:47.954412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:47.954866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:47.954866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:47.954866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:48.084813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:48.092468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-56062925-3802-4515-ac40-34d667362f04 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.152161 Aug 25 05:20:48.093033 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 372/753] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:47 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:49.112452 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:49.113027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:49.119507 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:49.119985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:49.120413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:49.121098 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:49.121545 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:49.121987 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:49.162378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-7be74e4b-2e20-490c-ace5-5fb611850dfd req-f4426b23-7261-442e-8eb5-ce927fec7fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0e0019-4497-4587-9bda-8b2f158a8863", "name": "network-vif-plugged", "status": "completed", "tag": "65bf2c10-1959-4066-8f1f-777c8aeea327"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:20:49.173166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7be74e4b-2e20-490c-ace5-5fb611850dfd req-f4426b23-7261-442e-8eb5-ce927fec7fc3 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:49.178563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7be74e4b-2e20-490c-ace5-5fb611850dfd req-f4426b23-7261-442e-8eb5-ce927fec7fc3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:49.178563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-7be74e4b-2e20-490c-ace5-5fb611850dfd req-f4426b23-7261-442e-8eb5-ce927fec7fc3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:49.185774 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-7be74e4b-2e20-490c-ace5-5fb611850dfd req-f4426b23-7261-442e-8eb5-ce927fec7fc3 service nova] Creating event network-vif-plugged:65bf2c10-1959-4066-8f1f-777c8aeea327 for instance 6e0e0019-4497-4587-9bda-8b2f158a8863 on hv-cinder-85391 Aug 25 05:20:49.190953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-7be74e4b-2e20-490c-ace5-5fb611850dfd req-f4426b23-7261-442e-8eb5-ce927fec7fc3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Aug 25 05:20:49.192367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 373/754] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:20:49.261279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:49.271320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a5db7edf-cadd-40e2-9a5d-e94ab9fffd47 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.162721 Aug 25 05:20:49.271997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 382/755] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:49 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:50.295358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:50.296049 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:50.302166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:50.302637 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:50.303071 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:50.303748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:50.304192 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:50.304607 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:50.435563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:50.443230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e018838d-78bb-45f8-9d03-3ea22f6e3c8b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.153252 Aug 25 05:20:50.443796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 374/756] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:50 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:51.463513 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:51.464114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:51.470548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:51.471019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:51.471694 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:51.472368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:51.472811 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:51.473220 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:51.602718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:51.611201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-87d2acab-4344-4aff-bcbe-5657f81cb3bc tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.151541 Aug 25 05:20:51.611770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 383/757] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:51 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:52.632286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:52.632892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:52.646511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:52.646993 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:52.647424 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:52.648113 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:52.648560 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:52.648979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:52.802292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:52.809786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-22a8bb59-226b-463a-bac6-e7007e03e0db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.181356 Aug 25 05:20:52.810350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 375/758] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:52 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:53.830921 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:53.831495 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:53.833411 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:53.838069 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:53.838548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:53.838976 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:53.839661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:53.840100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:53.840512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:53.974571 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:53.982823 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a7876d03-d920-465b-bb15-02961e81c0e2 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.155949 Aug 25 05:20:53.983393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 384/759] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:53 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:55.004004 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:55.004610 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:55.007123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:55.012537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:55.013011 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:55.013435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:55.014153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:55.014663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:55.015076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:55.018922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:55.143690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:55.151752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-26e8f573-5867-4521-b695-d8621f5aa821 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1361 microversion: 2.1 time: 0.151723 Aug 25 05:20:55.152480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 376/760] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:54 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:56.172715 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:56.173326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:56.179805 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:56.180283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:56.180712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:56.181400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:56.181880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:56.182302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:56.185441 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=73 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:20:56.311522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:20:56.319229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-52e356da-5933-4c6c-9370-04683aa0c6b8 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1548 microversion: 2.1 time: 0.150383 Aug 25 05:20:56.319797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 385/761] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:20:56 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:20:56.340410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:20:56.340914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:20:56.348618 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:56.349093 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:56.349524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:56.350299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:56.350749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:56.351168 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:56.431237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-becdc508-d17e-4bfc-ac95-dc01d18b4a27 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095490 Aug 25 05:20:56.431834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 377/762] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:20:56 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:20:57.393920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-46218bf2-a9f4-4a5c-807a-aa6bb09706b1 req-652dbb77-b458-48ce-9f4f-f3bd0b26b1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0e0019-4497-4587-9bda-8b2f158a8863", "tag": "65bf2c10-1959-4066-8f1f-777c8aeea327"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:20:57.404539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-46218bf2-a9f4-4a5c-807a-aa6bb09706b1 req-652dbb77-b458-48ce-9f4f-f3bd0b26b1ad service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:20:57.405011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-46218bf2-a9f4-4a5c-807a-aa6bb09706b1 req-652dbb77-b458-48ce-9f4f-f3bd0b26b1ad service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:20:57.405428 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-46218bf2-a9f4-4a5c-807a-aa6bb09706b1 req-652dbb77-b458-48ce-9f4f-f3bd0b26b1ad service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:20:57.417028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-46218bf2-a9f4-4a5c-807a-aa6bb09706b1 req-652dbb77-b458-48ce-9f4f-f3bd0b26b1ad service nova] Creating event network-changed:65bf2c10-1959-4066-8f1f-777c8aeea327 for instance 6e0e0019-4497-4587-9bda-8b2f158a8863 on hv-cinder-85391 Aug 25 05:20:57.422841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-46218bf2-a9f4-4a5c-807a-aa6bb09706b1 req-652dbb77-b458-48ce-9f4f-f3bd0b26b1ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032554 Aug 25 05:20:57.423432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 386/763] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:21:24.493938 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=9 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:24.495166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:24.499019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:24.499508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:24.505277 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:24.505822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:24.506281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:24.506966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:24.507415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:24.507836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:24.530695 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-dc77aace-4eac-4a68-ad17-05e68f3027bf tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/ips" status: 200 len: 150 microversion: 2.1 time: 0.038200 Aug 25 05:21:24.531262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 378/764] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:21:24 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:21:27.303824 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=5 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:27.304562 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=7 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:27.309306 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3157d83-3c84-46c1-a153-c35adf73de04"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:21:27.311726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:27.317729 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:27.318249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:27.318679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:27.319343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:27.319789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:27.320200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:28.158051 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-208a0b38-c247-473e-a75e-1445973c6980 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.855823 Aug 25 05:21:28.158799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 387/765] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:21:27 2022] POST /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:21:35.670603 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:35.671142 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:35.678138 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:35.678614 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:35.681437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:35.681437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:35.681437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:35.681437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:35.703394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b608d38e-bdf4-4d3d-b5c5-2952018a2024 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/ips" status: 200 len: 153 microversion: 2.20 time: 0.037551 Aug 25 05:21:35.704420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 379/766] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Aug 25 05:21:35 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:21:36.743016 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3157d83-3c84-46c1-a153-c35adf73de04"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:21:36.746187 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:36.752798 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:36.757239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:36.757239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:36.757239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:36.757239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:36.757579 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:36.836257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Invalid volume: volume c3157d83-3c84-46c1-a153-c35adf73de04 is already attached to instances: 940baae4-f323-4807-87d4-f556d88e3e8f Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: POST /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments HTTP/1.1 Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 74 Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:21:36.838542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {"volumeAttachment": {"volumeId": "c3157d83-3c84-46c1-a153-c35adf73de04"}} Aug 25 05:21:36.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Invalid volume: volume c3157d83-3c84-46c1-a153-c35adf73de04 is already attached to instances: 940baae4-f323-4807-87d4-f556d88e3e8f Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'server_id': '940baae4-f323-4807-87d4-f556d88e3e8f', 'body': {'volumeAttachment': {'volumeId': 'c3157d83-3c84-46c1-a153-c35adf73de04'}}} Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c3157d83-3c84-46c1-a153-c35adf73de04 is already attached to instances: 940baae4-f323-4807-87d4-f556d88e3e8f Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:21:36.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c3157d83-3c84-46c1-a153-c35adf73de04 is already attached to instances: 940baae4-f323-4807-87d4-f556d88e3e8f Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:21:36.846210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c3157d83-3c84-46c1-a153-c35adf73de04 is already attached to instances: 940baae4-f323-4807-87d4-f556d88e3e8f Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 400 to user: Invalid volume: volume c3157d83-3c84-46c1-a153-c35adf73de04 is already attached to instances: 940baae4-f323-4807-87d4-f556d88e3e8f {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fc46a15f-f590-4d4e-bbdf-db11fdfb819e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101999 Aug 25 05:21:36.848009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 388/767] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:21:36 2022] POST /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:21:36.903598 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:36.904073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:36.910450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:36.910926 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:36.911354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:36.912034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:36.912483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:36.912907 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:36.992410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lazy-loading 'services' on Instance uuid 940baae4-f323-4807-87d4-f556d88e3e8f {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:21:37.210399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-55988855-f668-41e7-8545-1953b6387c85 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments/c3157d83-3c84-46c1-a153-c35adf73de04" status: 202 len: 0 microversion: 2.1 time: 0.310982 Aug 25 05:21:37.210998 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 380/768] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:21:36 2022] DELETE /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments/c3157d83-3c84-46c1-a153-c35adf73de04 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:21:37.221027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:37.223466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:37.230413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:37.230894 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:37.231320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:37.232159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:37.232609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:37.233026 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:37.264711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9eb6c87a-5760-425d-a2e0-10f9be31703b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047548 Aug 25 05:21:37.265177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 389/769] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:21:37 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:21:38.278100 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:38.280409 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:38.286565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:38.287043 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:38.287475 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:38.288192 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:38.288640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:38.289058 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:38.318236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4eb3329d-7a0c-4b13-b1bb-b26777f4af93 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Aug 25 05:21:38.318796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 381/770] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:21:38 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:21:39.331106 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:39.333221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:39.340434 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.340910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.341339 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.342054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.342500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.342917 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.376525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5a623cee-94bc-442f-bdc3-21fc23b8f13d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049307 Aug 25 05:21:39.377080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 390/771] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:21:39 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:21:39.440817 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:39.441340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:39.448171 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.448651 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.449083 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.449798 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.450251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.456590 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.477022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:21:39.606991 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:21:39.607524 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:39.613345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.613866 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.614291 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.614976 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.615423 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.615842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.638233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lazy-loading 'flavor' on Instance uuid 15c73035-4140-417b-b820-a1f7ce16e591 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:21:39.782774 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5ab8d4cb-86ec-46cc-b51c-f3a5c67dfa9e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 204 len: 0 microversion: 2.1 time: 0.345473 Aug 25 05:21:39.784865 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 382/772] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:21:39 2022] DELETE /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:21:39.792905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:39.793612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:39.799398 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.799871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.800300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.800975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:39.801422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:39.801861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:39.930197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:39.938326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5ea13e92-e3c7-4a55-9e4e-bea6e120d4ed tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1681 microversion: 2.1 time: 0.150433 Aug 25 05:21:39.938892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 383/773] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:39 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:21:40.234195 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-17fbd8d0-3786-424b-9e37-85ade28b4217 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/action" status: 202 len: 0 microversion: 2.20 time: 0.631334 Aug 25 05:21:40.234793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 391/774] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Aug 25 05:21:39 2022] POST /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 05:21:40.243024 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:40.243635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:40.249662 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:40.250148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:40.250582 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:40.251268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:40.251720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:40.252146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:40.380975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:40.389193 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:40.390734 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:40.391887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bc2b74eb-af6d-4473-be3a-c07d4eae13d4 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.152810 Aug 25 05:21:40.392441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 384/775] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:40 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:40.961152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:40.961868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:40.968030 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:40.968501 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:40.968926 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:40.969615 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:40.974606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:40.974606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:41.099337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:41.107416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-85a9fe82-9d8e-4d89-bfd5-cc557baa546a tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1681 microversion: 2.1 time: 0.151000 Aug 25 05:21:41.107978 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 392/776] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:40 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:41.415241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:41.416495 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:41.422810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:41.423282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:41.423704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:41.424383 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:41.424824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:41.425238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:41.550966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:41.559145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:41.560650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:41.561836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-baecd95c-be47-40e3-aa90-96bac4ba4093 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.150680 Aug 25 05:21:41.562401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 385/777] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:41 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:42.128854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:42.129469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:42.136491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:42.136929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:42.137351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:42.138053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:42.138499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:42.138907 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:42.267041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:42.274589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0f1b5612-11ca-4a5f-814c-69d76fc11b69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1681 microversion: 2.1 time: 0.149579 Aug 25 05:21:42.275146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 393/778] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:42 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:42.584498 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:42.585044 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:42.591531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:42.592009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:42.592433 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:42.593114 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:42.593558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:42.594001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:42.717944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:42.726290 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:42.727791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:42.729433 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-35ed363b-cd73-42d4-b2b3-7d989665bfed tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.148937 Aug 25 05:21:42.730026 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 386/779] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:42 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:43.296191 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:43.296817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:43.303139 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:43.303611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:43.304031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:43.304698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:43.305135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:43.305547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:43.437403 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:43.445133 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0b5a98fe-18e4-4392-a2c1-7221f43b0152 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1681 microversion: 2.1 time: 0.153378 Aug 25 05:21:43.445712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 394/780] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:43 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:43.752624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:43.753237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:43.759786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:43.760262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:43.760694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:43.761375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:43.761860 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:43.762281 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:43.892633 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:43.900826 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:43.902360 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:43.904126 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fb1ae647-3b24-49e8-8e7a-9baaea79dd5a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.155507 Aug 25 05:21:43.904685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 387/781] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:43 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:44.466405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:44.472067 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:44.473521 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:44.474075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:44.474464 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:44.475145 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:44.475589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:44.476003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:44.609772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:44.617458 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4a8fbb9f-4716-45ba-a3d9-fdc6e51b3962 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1681 microversion: 2.1 time: 0.154891 Aug 25 05:21:44.618066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 395/782] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:44 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:44.927815 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:44.928428 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:44.936806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:44.937300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:44.937947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:44.938631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:44.939256 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:44.939834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:45.232739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:45.242459 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:45.244117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:45.245282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-20da3eb1-f2f3-4ccb-aabd-441a2f596aa9 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.322497 Aug 25 05:21:45.245886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 388/783] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:44 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:21:45.644528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:45.645278 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:45.651627 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:45.652102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:45.652532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:45.653907 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:45.654455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:45.654752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:45.715546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-d156e00a-484f-4b12-8457-547200ee2da4 req-2a6c8554-fd09-4bd2-96c0-4c1b4b76363b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940baae4-f323-4807-87d4-f556d88e3e8f", "name": "network-vif-deleted", "tag": "2545757e-3565-43ac-8647-9693f02cbdb1"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:21:45.722128 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:45.725950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d156e00a-484f-4b12-8457-547200ee2da4 req-2a6c8554-fd09-4bd2-96c0-4c1b4b76363b service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:45.726579 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d156e00a-484f-4b12-8457-547200ee2da4 req-2a6c8554-fd09-4bd2-96c0-4c1b4b76363b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:45.727102 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d156e00a-484f-4b12-8457-547200ee2da4 req-2a6c8554-fd09-4bd2-96c0-4c1b4b76363b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:45.732208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ab0b8a42-085d-41a5-aba0-81f437813583 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1614 microversion: 2.1 time: 0.091526 Aug 25 05:21:45.735171 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 396/784] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:45 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:45.741117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-d156e00a-484f-4b12-8457-547200ee2da4 req-2a6c8554-fd09-4bd2-96c0-4c1b4b76363b service nova] Creating event network-vif-deleted:2545757e-3565-43ac-8647-9693f02cbdb1 for instance 940baae4-f323-4807-87d4-f556d88e3e8f on hv-cinder-85391 Aug 25 05:21:45.746424 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-d156e00a-484f-4b12-8457-547200ee2da4 req-2a6c8554-fd09-4bd2-96c0-4c1b4b76363b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034720 Aug 25 05:21:45.747628 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 389/785] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:21:46.268988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:46.269641 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:46.275695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:46.276168 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:46.276594 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:46.277315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:46.278444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:46.283799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:46.410638 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:46.418580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:46.420063 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:46.421189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ea632520-e5da-453d-8885-7b76d37c1247 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.156301 Aug 25 05:21:46.421776 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 397/786] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:46 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:46.754470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:46.755722 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:46.761479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:46.784745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:46.784745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:46.784745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:46.784745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:46.785314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:46.831181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:46.839103 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-90cffa1c-913b-44be-9a99-189334ed4db6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1614 microversion: 2.1 time: 0.089591 Aug 25 05:21:46.839675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 390/787] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:46 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:47.443841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:47.445058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:47.451484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:47.451949 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:47.452372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:47.453046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:47.453487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:47.453927 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:47.583331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:47.591334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:47.593431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:47.594605 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-776b597c-5ac3-4502-94ec-3ce5c1c13e32 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.154691 Aug 25 05:21:47.595158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 398/788] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:47 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:47.860278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:47.860807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:47.867183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:47.867728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:47.868158 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:47.868836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:47.869284 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:47.869726 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:47.930658 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:47.938812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-798700e1-c009-48a2-b356-afd3c2b9c393 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1614 microversion: 2.1 time: 0.082471 Aug 25 05:21:47.939358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 391/789] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:47 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:48.617520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:48.618082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:48.624959 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:48.625435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:48.625905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:48.626591 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:48.627041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:48.627484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:48.756237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:48.764937 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:48.766469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:48.767623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fc6f4d4d-0f74-485c-a475-9820e582687a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.154144 Aug 25 05:21:48.768208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 399/790] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:48 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:48.961059 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:48.961860 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:48.968634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:48.969112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:48.969558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:48.970274 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:48.970720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:48.971137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:49.032777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:49.040305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-43a8361d-1fc5-4ff7-9aac-262cfd8bed18 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1614 microversion: 2.1 time: 0.083211 Aug 25 05:21:49.040872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 392/791] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:48 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:49.790801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:49.791388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:49.798695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:49.799169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:49.799594 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:49.800277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:49.800716 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:49.801127 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:49.805432 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:49.935382 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:49.943748 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:49.945314 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:49.946750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9626a10d-bb26-49c3-82cd-8cfd2bcec468 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.160058 Aug 25 05:21:49.947307 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 400/792] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:49 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:50.062472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:50.063018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:50.069471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:50.070009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:50.070450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:50.071164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:50.071620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:50.072043 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:50.090649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:50.104312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:50.104788 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:50.105673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:50.105797 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lazy-loading 'fault' on Instance uuid 940baae4-f323-4807-87d4-f556d88e3e8f {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:21:50.147808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:50.155414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f890a967-ab06-4b00-90fb-decc11facf30 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 200 len: 1331 microversion: 2.1 time: 0.096992 Aug 25 05:21:50.157253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 393/793] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:50 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:50.970762 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:50.971361 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:50.979087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:50.979570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:50.980037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:50.980816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:50.981219 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:50.981666 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:51.111813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:51.119705 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:51.121205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:51.122386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-285bf52e-f3f2-4da6-814b-4e3915adfb0d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.156146 Aug 25 05:21:51.122987 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 401/794] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:50 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:21:51.177278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:51.177903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:51.184558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:51.186412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:51.186412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:51.186412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:51.188020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:51.188020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:51.200032 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f HTTP/1.1 Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:21:51.201572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:21:51.203066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '940baae4-f323-4807-87d4-f556d88e3e8f'} Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:21:51.203856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:21:51.205333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:21:51.210003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:21:51.210003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c17de415-a8cc-48df-a864-fadafcd6357e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 404 len: 111 microversion: 2.1 time: 0.029880 Aug 25 05:21:51.210003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 394/795] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:51 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:21:51.211755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-277b39e8-b4ad-452d-8357-f0fdf5b03032 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '.version_select at 0x7f2423a1b0d0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:51.309114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-277b39e8-b4ad-452d-8357-f0fdf5b03032 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103978130" status: 202 len: 0 microversion: 2.1 time: 0.101084 Aug 25 05:21:51.309735 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 402/796] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Aug 25 05:21:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1103978130 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:21:52.117688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4d7cadbe-dce0-45b7-a947-573cd8c2dc9f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: .version_select at 0x7f2423b98820>, body: {"keypair": {"name": "tempest-keypair-715153154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZOtildWxmkWDm5xHNOclreLjbQggmOx6erKDJ6ZuLxBU16oa5jeCbkLHpy1MBFbtaiBmzOTb8njp0LMzp8FFrktu9kGVRNS9H4U0Mx6QHKPCES3YDajZVSsHGiHnIvFQ=="}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:21:52.133944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-4d7cadbe-dce0-45b7-a947-573cd8c2dc9f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:21:52.137770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-4d7cadbe-dce0-45b7-a947-573cd8c2dc9f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:21:52.144752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:52.145359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:52.151675 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:52.200717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:52.200717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:52.200717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:52.200717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:52.201113 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:52.285149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:52.293566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:52.295080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:52.296738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0d5e18f2-0774-4032-9a17-d82ab0c442e8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.156342 Aug 25 05:21:52.297294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 403/797] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:52 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:52.378358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4d7cadbe-dce0-45b7-a947-573cd8c2dc9f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264514 Aug 25 05:21:52.379149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 395/798] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:21:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:21:53.319996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:53.320601 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:53.327622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:53.328097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:53.328525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:53.329203 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:53.329673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:53.330094 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:53.485663 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:53.493841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:53.495338 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:53.496485 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6dd7c9bd-1490-4f0c-b1b6-53682a504daa tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.180403 Aug 25 05:21:53.497038 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 404/799] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:53 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:54.520943 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:54.521570 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:54.528435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:54.528913 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:54.529370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:54.530704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:54.531378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:54.531796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:54.663486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:54.671687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:54.673178 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:54.674404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-517860cd-40a2-4c9a-a9dc-61f1f5f52d21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.158031 Aug 25 05:21:54.674950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 396/800] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:54 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:54.777472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1979612340", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68f1da36-d799-4803-8568-258dd71a0604"}], "security_groups": [{"name": "tempest-securitygroup--2129635933"}], "key_name": "tempest-keypair-715153154", "user_data": "}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:21:54.877679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] validate_networks() for [('68f1da36-d799-4803-8568-258dd71a0604', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:21:55.277091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:21:55.277511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:21:55.278012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:21:55.278413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:21:55.278815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:21:55.287749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:55.288268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:55.288388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:55.289629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:55.289629 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:55.289933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:55.306954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:21:55.310774 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Getting quotas for user ec39d995899c4d43bb4f8ffd9e6d2ef3 and project f640cb592ed1455a827976752ce2f49d. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:21:55.322533 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:21:55.325345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:21:55.485932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [b89fde2d-fa40-48c9-a690-9717305b4bdc] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 05:21:55.697912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:55.698525 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:55.705147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:55.705640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:55.706073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:55.706787 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:55.707235 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:55.707656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:55.836436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:55.845259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:55.847075 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:55.848223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8fa51f29-ecf9-4dc8-aa12-342b8eec015e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.154252 Aug 25 05:21:55.848966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 397/801] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:55 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:21:56.492017 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO oslo.messaging._drivers.impl_rabbit [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [b89fde2d-fa40-48c9-a690-9717305b4bdc] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 48022. Aug 25 05:21:56.496039 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bf597b6f-0692-4a27-9fc3-b178ba794d99 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.722860 Aug 25 05:21:56.496698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 405/802] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:21:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:21:56.510117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9572ccf4-79e1-418c-877c-f72c111033d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:56.512132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9572ccf4-79e1-418c-877c-f72c111033d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:56.565360 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9572ccf4-79e1-418c-877c-f72c111033d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:56.572793 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9572ccf4-79e1-418c-877c-f72c111033d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1241 microversion: 2.1 time: 0.066957 Aug 25 05:21:56.573363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 398/803] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:56 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:56.874256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:56.874865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:56.880772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:56.881259 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:56.881681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:56.882356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:56.885407 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:56.885939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:57.019867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:57.029134 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:57.030189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:57.031368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b04d92bb-2ce8-437a-a3b4-7d4857ecba2c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.162062 Aug 25 05:21:57.031925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 406/804] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:56 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:57.592145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-396937e2-3d0e-4708-8906-6f00753b3b1e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:57.593284 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-396937e2-3d0e-4708-8906-6f00753b3b1e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:57.649195 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-396937e2-3d0e-4708-8906-6f00753b3b1e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:57.657083 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-396937e2-3d0e-4708-8906-6f00753b3b1e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1241 microversion: 2.1 time: 0.068759 Aug 25 05:21:57.658371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 399/805] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:57 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:58.054718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:58.055326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:58.057622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:21:58.062887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:58.063360 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:58.063789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:58.064469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:58.064914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:58.065333 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:58.195864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:58.204003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:58.205503 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:58.206707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-534dbd41-c2bd-472e-a1a8-80d0ca7228e0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.156027 Aug 25 05:21:58.207263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 407/806] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:58 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:21:58.677479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cd447194-8120-45cf-a9c5-43396e104329 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:58.678119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cd447194-8120-45cf-a9c5-43396e104329 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:58.730251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cd447194-8120-45cf-a9c5-43396e104329 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:58.737776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cd447194-8120-45cf-a9c5-43396e104329 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1241 microversion: 2.1 time: 0.064096 Aug 25 05:21:58.738337 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 400/807] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:58 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:21:59.230553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:59.231155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:59.237492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:59.237986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:59.238410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:59.239082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:21:59.239522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:21:59.239933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:21:59.370299 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:59.379019 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:59.380612 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:59.381798 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5e252804-2149-4010-8cca-2ea564fb4a21 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.155472 Aug 25 05:21:59.382355 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 408/808] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:21:59 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:21:59.758332 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d7183cfe-7c4e-46fa-b0de-256eba7d82d8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:21:59.758863 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d7183cfe-7c4e-46fa-b0de-256eba7d82d8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:21:59.811130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d7183cfe-7c4e-46fa-b0de-256eba7d82d8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:21:59.818607 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d7183cfe-7c4e-46fa-b0de-256eba7d82d8 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1241 microversion: 2.1 time: 0.064218 Aug 25 05:21:59.819169 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 401/809] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:21:59 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:22:00.404671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:00.405269 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:00.412266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:00.412737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:00.413225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:00.413940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:00.414385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:00.414793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:00.771233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:00.779228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:00.780789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:00.781952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8fa33d73-66a1-416d-be86-9c452e0d7aa5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.381558 Aug 25 05:22:00.782496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 409/810] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:00 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:00.839053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:00.839660 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:00.846035 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:00.846500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:00.847177 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:00.847853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:00.848295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:00.848709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:00.911074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:00.918686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5db99bb1-b7d2-4e68-b560-e32ca729c516 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1245 microversion: 2.1 time: 0.083450 Aug 25 05:22:00.919265 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 402/811] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:00 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:22:01.804449 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:01.805186 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:01.812055 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:01.812499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:01.812954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:01.813662 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:01.814115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:01.817306 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:01.939760 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:01.940516 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:01.947968 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:01.948453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:01.948725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:01.949073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:01.949793 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:01.950464 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:01.951349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:01.958053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:01.959617 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:01.964803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9d590075-2649-43b3-840c-d570e0436407 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1747 microversion: 2.20 time: 0.160457 Aug 25 05:22:01.964803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 410/812] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:01 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:02.028363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:02.036518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5607eee0-06fd-46bd-87a7-8b8f79189a08 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1237 microversion: 2.1 time: 0.100948 Aug 25 05:22:02.037081 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 403/813] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:01 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:02.986362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:02.987100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:02.993847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:02.994435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:02.994974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:02.995765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:02.996308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:02.996818 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:03.058177 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:03.058800 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:03.065340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:03.065992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:03.066283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:03.066971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:03.067667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:03.068089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:03.150499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:03.155055 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:03.164494 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e80c940a-28fb-48f6-aa76-ac7db7fbcb15 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1301 microversion: 2.1 time: 0.110382 Aug 25 05:22:03.167375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 404/814] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:03 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:22:03.181275 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:03.183074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:03.184276 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-892c1815-1463-433e-b434-498982cc3722 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1747 microversion: 2.20 time: 0.202626 Aug 25 05:22:03.184835 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 411/815] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:02 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1747 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:04.185933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:04.186853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:04.193754 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:04.194250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:04.195884 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:04.196951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:04.197383 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:04.197874 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:04.207281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:04.209840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:04.214840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:04.215324 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:04.215752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:04.216440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:04.216883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:04.217992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:04.352028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:04.360758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:04.362270 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:04.363420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bc162ab0-011f-4469-a84f-b69278e92dbc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1747 microversion: 2.20 time: 0.160107 Aug 25 05:22:04.364150 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 412/816] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:04 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:04.415848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:04.423977 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0f902493-fc95-4b5a-b981-5628799372d5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.241832 Aug 25 05:22:04.424551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 405/817] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:04 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:22:04.853204 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-0f3acddd-5bcc-418c-a644-7835a1e3a2a5 req-f8b5786e-55dc-40c8-abf8-99ac929c8206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13c1236-a24c-478a-ac43-a1035b100bd5", "tag": "b3efd045-f9cf-4456-a70e-5318feee2f25"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:04.862892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-0f3acddd-5bcc-418c-a644-7835a1e3a2a5 req-f8b5786e-55dc-40c8-abf8-99ac929c8206 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:04.863359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-0f3acddd-5bcc-418c-a644-7835a1e3a2a5 req-f8b5786e-55dc-40c8-abf8-99ac929c8206 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:04.863777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-0f3acddd-5bcc-418c-a644-7835a1e3a2a5 req-f8b5786e-55dc-40c8-abf8-99ac929c8206 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:05.023234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-0f3acddd-5bcc-418c-a644-7835a1e3a2a5 req-f8b5786e-55dc-40c8-abf8-99ac929c8206 service nova] Creating event network-changed:b3efd045-f9cf-4456-a70e-5318feee2f25 for instance e13c1236-a24c-478a-ac43-a1035b100bd5 on hv-cinder-85391 Aug 25 05:22:05.027969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-0f3acddd-5bcc-418c-a644-7835a1e3a2a5 req-f8b5786e-55dc-40c8-abf8-99ac929c8206 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178694 Aug 25 05:22:05.028550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 413/818] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:05.386435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:05.387206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:05.394439 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:05.395231 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:05.395881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:05.396736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:05.397288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:05.397829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:05.442479 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:05.443417 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=6 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:05.453701 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:05.455117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:05.463819 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:05.464308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:05.464737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:05.465491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:05.466013 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:05.466459 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:05.579323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:05.588508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:05.590420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:05.591919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c2b8c276-026b-4956-ba4c-7743760600eb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1747 microversion: 2.20 time: 0.209836 Aug 25 05:22:05.604342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:05.609661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 406/819] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:05 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1747 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:05.613380 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-aa4cb745-4aa1-4374-8b10-502d6ee8de5e tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.172237 Aug 25 05:22:05.614568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 414/820] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:05 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:05.616196 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-0553fafd-0a0e-4024-936b-ea5eeda13885 req-00a21fdb-21f5-4d59-9a2b-25691209de08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c73035-4140-417b-b820-a1f7ce16e591", "name": "network-vif-plugged", "status": "completed", "tag": "734e6925-ff8f-414a-b2c5-79868183c1ba"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:05.631796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-0553fafd-0a0e-4024-936b-ea5eeda13885 req-00a21fdb-21f5-4d59-9a2b-25691209de08 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:05.632403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-0553fafd-0a0e-4024-936b-ea5eeda13885 req-00a21fdb-21f5-4d59-9a2b-25691209de08 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:05.632819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-0553fafd-0a0e-4024-936b-ea5eeda13885 req-00a21fdb-21f5-4d59-9a2b-25691209de08 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:05.644371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-0553fafd-0a0e-4024-936b-ea5eeda13885 req-00a21fdb-21f5-4d59-9a2b-25691209de08 service nova] Creating event network-vif-plugged:734e6925-ff8f-414a-b2c5-79868183c1ba for instance 15c73035-4140-417b-b820-a1f7ce16e591 on hv-cinder-85391 Aug 25 05:22:05.649272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-0553fafd-0a0e-4024-936b-ea5eeda13885 req-00a21fdb-21f5-4d59-9a2b-25691209de08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038215 Aug 25 05:22:05.649911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 407/821] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:06.615609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:06.616124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:06.622397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:06.622869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:06.623294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:06.623974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:06.624924 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:06.625338 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:06.639619 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:06.640905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:06.642915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:06.647742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:06.648223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:06.648678 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:06.649395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:06.649874 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:06.650323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:06.754652 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:06.763026 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:06.764584 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:06.766601 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-659d062d-43e5-492c-8f38-a7cf1c950fd8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1747 microversion: 2.20 time: 0.154988 Aug 25 05:22:06.767157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 415/822] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:06 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:06.783460 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:06.791327 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5b35144f-6562-49ee-9817-82a5bd49dd1b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.156502 Aug 25 05:22:06.791882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 408/823] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:06 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:07.789317 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:07.789933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:07.796865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:07.797356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:07.797806 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:07.798488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:07.798935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:07.799353 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:07.811277 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:07.812492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:07.818926 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:07.819404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:07.819856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:07.820551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:07.821001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:07.821425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:07.931394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:07.940117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:07.941615 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:07.942766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-72fd3b9f-69f8-41c3-bfd0-8443e9756a22 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1747 microversion: 2.20 time: 0.157355 Aug 25 05:22:07.943313 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 416/824] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:07 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:07.949915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:07.957694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5c479328-8ba3-4b95-9b1c-bfe4838d9026 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.150346 Aug 25 05:22:07.958259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 409/825] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:07 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:08.966808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:08.967312 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:08.973930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:08.974474 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:08.974905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:08.975584 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:08.976022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:08.976435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:08.978931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:08.979547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:08.986849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:08.987321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:08.987740 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:08.988427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:08.988863 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:08.989277 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:09.106727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:09.115022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:09.116565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:09.117762 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0e41670d-7231-4cda-be64-15daf4e07636 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1747 microversion: 2.20 time: 0.155082 Aug 25 05:22:09.118324 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 417/826] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:08 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:09.122665 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:09.130866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5c25da40-b23d-4da8-965b-95c1066d486d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.155915 Aug 25 05:22:09.131425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 410/827] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:08 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:10.143150 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:10.143656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:10.153451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:10.154081 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:10.156936 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=12 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:10.166451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:10.172879 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:10.176005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:10.176005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:10.176005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:10.177081 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:10.177677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:10.180190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:10.180994 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:10.181840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:10.185995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:10.186428 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:10.342425 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:10.352314 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:10.354342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:10.356034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0e71191e-5795-4beb-85d5-d8b58875781d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.218735 Aug 25 05:22:10.357137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 418/828] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:10 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:10.387280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:10.395536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8fb3f841-4d75-448f-a938-9854cdd16060 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.246613 Aug 25 05:22:10.397008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 411/829] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:10 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:11.380487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:11.381094 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:11.388111 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:11.388592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:11.389032 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:11.391086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:11.391725 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:11.392306 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:11.396894 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=100 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:11.422715 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:11.423314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:11.439157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:11.440219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:11.440856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:11.441794 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:11.442439 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:11.443062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:11.583622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:11.592093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:11.594234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:11.595399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-99e84716-c128-4e8b-ba4b-5eda24b4c1d8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.218861 Aug 25 05:22:11.600932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 419/830] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:11 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:11.622973 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:11.632443 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fcb5c1aa-4752-44bd-a3a3-de592be07d56 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.213431 Aug 25 05:22:11.633040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 412/831] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:11 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:22:12.624627 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:12.625265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:12.632461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:12.632951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:12.633359 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:12.634074 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:12.634523 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:12.634932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:12.660423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:12.661030 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:12.668497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:12.669377 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:12.670177 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:12.672682 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:12.673537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:12.675406 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:12.774920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:12.783781 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:12.785273 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:12.786469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-af682a5e-9560-4327-8e02-9f3f5766607c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.165953 Aug 25 05:22:12.787022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 420/832] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:12 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:12.824810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:12.833367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fbe42c19-6c5f-4794-8237-2c84f1209858 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.177588 Aug 25 05:22:12.834029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 413/833] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:12 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:22:13.580116 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-59ef486a-9e0f-4462-8eaa-ddb806d134e5 req-1176822b-1d2f-4e27-9b65-2a4907d3584b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13c1236-a24c-478a-ac43-a1035b100bd5", "name": "network-vif-plugged", "status": "completed", "tag": "b3efd045-f9cf-4456-a70e-5318feee2f25"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:13.608961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-59ef486a-9e0f-4462-8eaa-ddb806d134e5 req-1176822b-1d2f-4e27-9b65-2a4907d3584b service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:13.609522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-59ef486a-9e0f-4462-8eaa-ddb806d134e5 req-1176822b-1d2f-4e27-9b65-2a4907d3584b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:13.610027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-59ef486a-9e0f-4462-8eaa-ddb806d134e5 req-1176822b-1d2f-4e27-9b65-2a4907d3584b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:13.622672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-59ef486a-9e0f-4462-8eaa-ddb806d134e5 req-1176822b-1d2f-4e27-9b65-2a4907d3584b service nova] Creating event network-vif-plugged:b3efd045-f9cf-4456-a70e-5318feee2f25 for instance e13c1236-a24c-478a-ac43-a1035b100bd5 on hv-cinder-85391 Aug 25 05:22:13.630374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-59ef486a-9e0f-4462-8eaa-ddb806d134e5 req-1176822b-1d2f-4e27-9b65-2a4907d3584b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058424 Aug 25 05:22:13.632272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 421/834] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:13.815257 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:13.816142 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:13.823164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:13.823873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:13.824477 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:13.830382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:13.830898 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:13.843798 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:13.856814 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:13.857914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:13.871528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:13.872389 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:13.875692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:13.876804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:13.877487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:13.879550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:14.040275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:14.050201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:14.052239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:14.056927 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:14.059777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7e903b2f-0ade-46e4-822e-c7867fee7604 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.208182 Aug 25 05:22:14.060177 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ce9f8fef-603d-46b9-b6a0-05a8c65cab3c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.250832 Aug 25 05:22:14.062777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 414/835] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:13 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:14.076550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 422/836] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:13 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:22:15.083535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:15.084345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:15.091095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:15.098566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:15.099688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:15.103511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:15.105987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:15.106959 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:15.107119 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:15.107754 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:15.107953 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:15.108386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:15.108531 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:15.110402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:15.111792 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:15.114715 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:15.278720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:15.290009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:15.292833 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:15.294449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b8440202-e7de-4a95-8629-257b27eb4f4c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.214934 Aug 25 05:22:15.296450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 415/837] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:15 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:15.297539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:15.307780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-53fd7a2e-8107-4926-8e34-1ba3733d67f5 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1367 microversion: 2.1 time: 0.213245 Aug 25 05:22:15.309289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 423/838] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:15 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:16.329039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:16.329807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:16.329981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:16.330595 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:16.336434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:16.336920 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:16.337048 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:16.337353 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:16.337462 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:16.337878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:16.338073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:16.338526 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:16.338630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:16.338953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:16.339102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:16.339395 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:16.343695 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:16.481709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:16.491110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:16.492320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:16.494156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:16.495883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c7c3de3d-6570-460e-8fd4-bba7858ae477 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.169748 Aug 25 05:22:16.496636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 424/839] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:16 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:22:16.509474 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5577b502-9844-42dc-8898-48af0d920b42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1557 microversion: 2.1 time: 0.184350 Aug 25 05:22:16.510088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 416/840] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:22:16 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:22:16.532457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:16.533206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:16.539248 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:16.539724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:16.540315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:16.541198 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:16.541679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:16.542259 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:16.629829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5537a27e-3113-427e-8625-019ce7a9ad69 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101748 Aug 25 05:22:16.630496 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 425/841] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Aug 25 05:22:16 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:17.519145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:17.520471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:17.532601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:17.533230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:17.533811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:17.534644 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:17.544394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:17.544995 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:17.919382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:17.930028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:17.931869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:17.933437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-de794295-4275-41e3-80d3-3443e453f9ea tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.418293 Aug 25 05:22:17.950393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 417/842] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:17 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:18.254268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-64a9a6dc-4e29-4188-91b2-803c17b2e70e req-c3a90375-f792-4053-ae7d-cb2c14886cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13c1236-a24c-478a-ac43-a1035b100bd5", "tag": "b3efd045-f9cf-4456-a70e-5318feee2f25"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:18.268075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-64a9a6dc-4e29-4188-91b2-803c17b2e70e req-c3a90375-f792-4053-ae7d-cb2c14886cdf service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:18.268639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-64a9a6dc-4e29-4188-91b2-803c17b2e70e req-c3a90375-f792-4053-ae7d-cb2c14886cdf service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:18.269102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-64a9a6dc-4e29-4188-91b2-803c17b2e70e req-c3a90375-f792-4053-ae7d-cb2c14886cdf service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:18.300688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-64a9a6dc-4e29-4188-91b2-803c17b2e70e req-c3a90375-f792-4053-ae7d-cb2c14886cdf service nova] Creating event network-changed:b3efd045-f9cf-4456-a70e-5318feee2f25 for instance e13c1236-a24c-478a-ac43-a1035b100bd5 on hv-cinder-85391 Aug 25 05:22:18.306673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-64a9a6dc-4e29-4188-91b2-803c17b2e70e req-c3a90375-f792-4053-ae7d-cb2c14886cdf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057082 Aug 25 05:22:18.311969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 426/843] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:22:18.957095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:18.958500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:18.965962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:18.966841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:18.968095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:18.969146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:18.969646 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:18.970331 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:19.147605 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:19.156525 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:19.158065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:19.159210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5d4e1f53-e045-4a63-a0ef-0a7f480e4016 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.206453 Aug 25 05:22:19.159767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 418/844] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:18 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:20.188514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:20.189237 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:20.197088 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:20.197570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:20.198255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:20.199174 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:20.200009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:20.201035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:20.349236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:20.358066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:20.359574 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:20.361175 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-42394519-5b10-4ffb-9b9f-8ebdfbe5d446 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.181982 Aug 25 05:22:20.361662 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 427/845] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:20 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:21.384093 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:21.384745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:21.391854 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:21.392327 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:21.392755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:21.393461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:21.393946 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:21.394366 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:21.522829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:21.531742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:21.533245 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:21.534419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d1d95686-4fae-4eff-81bd-646d687d464f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1742 microversion: 2.20 time: 0.154229 Aug 25 05:22:21.534975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 419/846] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:21 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:22.556281 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:22.556814 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:22.563699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:22.564169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:22.564591 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:22.565262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:22.565729 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:22.566142 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:22.694857 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:22.703572 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:22.705107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:22.706289 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a0278c80-c605-4554-8c14-6c1b68e1c980 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1724 microversion: 2.20 time: 0.153985 Aug 25 05:22:22.706851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 428/847] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:22 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:23.729101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:23.729862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:23.736427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:23.736904 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:23.737333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:23.738045 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:23.738497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:23.738912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:23.866253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:23.874939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:23.876416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:23.877547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-89203b6c-01f7-46f8-81b8-7a2438869dc8 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1724 microversion: 2.20 time: 0.152494 Aug 25 05:22:23.878137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 420/848] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:23 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:24.900494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:24.901165 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:24.907797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:24.908276 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:24.908701 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:24.909372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:24.909842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:24.910256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:25.039787 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:25.047887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:25.049497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:25.051502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b577c107-1934-45c5-a707-7e457c882293 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1727 microversion: 2.20 time: 0.154884 Aug 25 05:22:25.052123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 429/849] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:24 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:25.073694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4da3ef3-8d09-4566-8fe8-85031dd4ea76"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:25.076031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:25.082953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:25.083442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:25.083870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:25.084556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:25.085007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:25.085429 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:25.559577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-79a85297-fc79-4142-b3d0-de3423c13b76 req-db695edc-3264-42a7-90f4-c4af7a0e0246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c73035-4140-417b-b820-a1f7ce16e591", "name": "network-vif-unplugged", "status": "completed", "tag": "734e6925-ff8f-414a-b2c5-79868183c1ba"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:25.569414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-79a85297-fc79-4142-b3d0-de3423c13b76 req-db695edc-3264-42a7-90f4-c4af7a0e0246 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:25.569912 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-79a85297-fc79-4142-b3d0-de3423c13b76 req-db695edc-3264-42a7-90f4-c4af7a0e0246 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:25.570333 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-79a85297-fc79-4142-b3d0-de3423c13b76 req-db695edc-3264-42a7-90f4-c4af7a0e0246 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:25.581752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.compute.server_external_events [req-79a85297-fc79-4142-b3d0-de3423c13b76 req-db695edc-3264-42a7-90f4-c4af7a0e0246 service nova] Unable to find a host for instance 15c73035-4140-417b-b820-a1f7ce16e591. Dropping event network-vif-unplugged {{(pid=121314) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 05:22:25.582595 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-79a85297-fc79-4142-b3d0-de3423c13b76 req-db695edc-3264-42a7-90f4-c4af7a0e0246 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026946 Aug 25 05:22:25.583145 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 430/850] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 25 05:22:26.078371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-50f3b903-3f0b-4e05-a538-165dbd3bf1f3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.008636 Aug 25 05:22:26.078908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 421/851] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Aug 25 05:22:25 2022] POST /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-volume_attachments => generated 188 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 05:22:26.352580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:26.353079 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:26.360201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:26.360676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:26.361107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:26.361826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:26.362318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:26.362741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:27.049292 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-65ca5460-f82c-4f7c-be90-15f792e4ffe1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-volume_attachments/b4da3ef3-8d09-4566-8fe8-85031dd4ea76" status: 202 len: 0 microversion: 2.20 time: 0.700647 Aug 25 05:22:27.049841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 431/852] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Aug 25 05:22:26 2022] DELETE /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-volume_attachments/b4da3ef3-8d09-4566-8fe8-85031dd4ea76 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:22:27.110364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:27.110953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:27.117362 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:27.117871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:27.118301 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:27.119008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:27.119453 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:27.119871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:27.162574 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121310) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 05:22:27.430323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-58907745-87d3-499d-bfbd-b99cebad6a42 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "POST /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/action" status: 202 len: 0 microversion: 2.20 time: 0.323875 Aug 25 05:22:27.431113 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 422/853] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Aug 25 05:22:27 2022] POST /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:22:27.439620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:27.440247 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:27.447226 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:27.447708 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:27.448144 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:27.448844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:27.449301 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:27.449754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:27.579699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:27.587960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:27.589553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:27.590739 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e5083d8a-7917-4f87-80f9-cf6fa88fb39e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1675 microversion: 2.20 time: 0.155696 Aug 25 05:22:27.591610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 432/854] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:27 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:28.621956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:28.622572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:28.629667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:28.630150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:28.630583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:28.631442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:28.631891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:28.632316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:28.762148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:28.770756 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:28.772262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:28.773412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d4e81a06-7ae5-4c49-9e90-49d6b0d68014 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1675 microversion: 2.20 time: 0.160485 Aug 25 05:22:28.774015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 423/855] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:28 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:29.797435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:29.798068 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:29.800967 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=52 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:29.806349 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:29.806868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:29.807306 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:29.808026 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:29.808508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:29.808932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:29.947469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:29.956334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:29.957885 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:29.959031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2bba8188-053e-4108-af0a-8f40ef7df5c5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.165987 Aug 25 05:22:29.962117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 433/856] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:29 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:30.983210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:30.983796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:30.992728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:30.996152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:30.996152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:30.996152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:30.996152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:30.996585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:31.165914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:31.175074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:31.176961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:31.178408 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d42176ca-0b86-44a4-be37-d4a7fbc1043c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.199314 Aug 25 05:22:31.179226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 424/857] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:30 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:32.206043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:32.206586 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:32.214706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:32.215194 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:32.215633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:32.216338 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:32.216791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:32.217220 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:32.359228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:32.368346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:32.369922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:32.371239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2a389faa-48ea-4892-88ca-693a0dfff37f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.169284 Aug 25 05:22:32.372142 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 434/858] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:32 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:33.394117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:33.394967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:33.401703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:33.402183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:33.402609 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:33.403300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:33.403737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:33.404305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:33.542490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:33.551361 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:33.552849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:33.554027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ae58b568-96f3-4efc-9eda-7afb6ed2c5cc tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.163887 Aug 25 05:22:33.569661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 425/859] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:33 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:34.577521 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:34.578177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:34.585108 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:34.585582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:34.586045 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:34.586737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:34.587189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:34.587611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:34.725897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:34.728111 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:34.736830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:34.739597 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:34.739597 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-aed0bb9c-2904-4b63-9ccc-d4ef766177bb tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.166059 Aug 25 05:22:34.740230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 435/860] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:34 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:35.763499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:35.764139 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:35.771665 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:35.772152 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:35.772585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:35.773286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:35.773768 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:35.774194 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:35.909628 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:35.917951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:35.919568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:35.920824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-65f5362b-f62d-485e-a19f-b8d15136760f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.161347 Aug 25 05:22:35.921426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 426/861] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:35 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:36.946158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:36.946761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:36.953920 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:36.954444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:36.955417 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:36.956243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:36.956700 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:36.957148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:37.093857 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:37.103531 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:37.105161 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:37.106451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-15d5a00e-99d4-4b4d-9956-56b5c5bffeab tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.164685 Aug 25 05:22:37.114009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 436/862] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:36 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:37.339574 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:37.340227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:37.344436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:37.351098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:37.360488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:37.360488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:37.360488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:37.360488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:37.361192 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:37.378119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bc44405c-b654-4803-ab39-fac6ca1536f5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/ips" status: 200 len: 147 microversion: 2.1 time: 0.042371 Aug 25 05:22:37.378702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 427/863] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:22:37 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:38.129746 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:38.130467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:38.137049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:38.137664 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:38.138093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:38.138781 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:38.139233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:38.139651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:38.285337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:38.300372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:38.301886 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:38.303080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fd425fa6-7d4a-41df-9f01-bf3687fb4270 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.177462 Aug 25 05:22:38.303671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 437/864] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:38 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:39.326751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:39.327387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:39.335027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:39.335518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:39.335949 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:39.336870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:39.337325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:39.337784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:39.485729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:39.494668 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:39.496170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:39.497401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-84b7a4bb-0ced-473a-8b0f-cb3e67f2351d tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.174798 Aug 25 05:22:39.498005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 428/865] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:39 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:40.461679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45ba0faa-6de8-4ea8-9203-34a5399fbca7"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:40.464105 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:40.470851 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:40.471340 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:40.471771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:40.472716 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:40.473162 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:40.473602 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:40.522529 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:40.522972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:40.528821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:40.529455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:40.529970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:40.530777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:40.531218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:40.531632 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:40.551723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:22:40.663750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:40.671788 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:40.674193 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:40.675351 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-43820073-bc51-46b4-bfe0-8b309f548db0 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.159014 Aug 25 05:22:40.675988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 429/866] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:40 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:41.699162 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:41.699805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:41.706085 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:41.706585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:41.707007 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:41.707680 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:41.708120 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:41.708531 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:41.833617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:41.841645 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:41.843138 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:41.844270 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6045d5d1-cccc-483e-a407-219f40af974a tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.149303 Aug 25 05:22:41.844822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 430/867] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:41 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:22:42.867536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:42.868218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:42.874406 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:42.874877 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:42.875299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:42.875969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:42.876930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:42.877342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:43.005130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:43.013521 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:43.015468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:43.016608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-173a0dae-01d3-4eb9-bd0d-ffa2876632bf tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.152990 Aug 25 05:22:43.017163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 431/868] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:42 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:22:44.039412 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:44.040051 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:44.046404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:44.046872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:44.047299 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:44.047971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:44.048414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:44.048826 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:44.177205 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:44.185275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:44.186834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:44.188017 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b7c95504-9194-4808-bf3c-897eea1eae58 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.152504 Aug 25 05:22:44.188573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 432/869] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:44 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:22:45.210844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:45.211592 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:45.217955 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:45.218435 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:45.218866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:45.219549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:45.220019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:45.220410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:45.345772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:45.353985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:45.355466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:45.356597 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d55218e8-0d40-4d10-9461-ace0068c1a31 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.149588 Aug 25 05:22:45.357153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 433/870] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:45 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:22:46.380592 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:46.381219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:46.387474 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:46.387942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:46.388364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:46.389035 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:46.389477 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:46.389918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:46.519974 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:46.527977 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:46.529456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:46.530618 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-18efb9cc-148d-4203-bf59-c741d34ecb5f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.154491 Aug 25 05:22:46.531170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 434/871] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:46 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:22:47.157207 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-342f364d-593e-4847-9b5e-dde56d567887 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.699301 Aug 25 05:22:47.160794 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 438/872] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:22:40 2022] POST /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments => generated 194 bytes in 6701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:47.552699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:47.553311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:47.560966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:47.561467 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:47.561910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:47.562947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:47.563396 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:47.563808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:47.698242 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:47.740269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:47.740269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:47.740269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1ec340c2-53f6-49cf-8265-ce87d191dff5 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.159601 Aug 25 05:22:47.740575 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 435/873] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:47 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:48.733404 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:48.734034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:48.740812 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:48.741283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:48.741736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:48.742412 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:48.742854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:48.743267 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:48.871999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:48.880007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:48.881495 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:48.882662 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-901b1297-f3a8-4314-ad24-7b59f7e6de19 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.154108 Aug 25 05:22:48.883241 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 439/874] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:48 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:49.905701 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:49.906341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:49.912762 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:49.913237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:49.913724 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:49.914407 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:49.914852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:49.915285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:50.048636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:50.056707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:50.058251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:50.059400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fa733983-abe0-4429-a831-5086edbaf258 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.157682 Aug 25 05:22:50.059969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 436/875] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:49 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:51.082505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:51.083126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:51.089497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:51.089996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:51.090423 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:51.091099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:51.091538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:51.091949 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:51.217266 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:51.225859 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:51.227386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:51.228526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-db27bdee-8e50-4868-8dde-81e81469d419 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.150613 Aug 25 05:22:51.229332 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 440/876] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:51 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:51.681167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-c0c92ccd-acfa-4dbf-b46e-a2371c1fa062 req-d594e46b-6fe1-4bf8-9ad2-f21b1a8adaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c73035-4140-417b-b820-a1f7ce16e591", "name": "network-vif-plugged", "status": "completed", "tag": "734e6925-ff8f-414a-b2c5-79868183c1ba"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:51.691821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c0c92ccd-acfa-4dbf-b46e-a2371c1fa062 req-d594e46b-6fe1-4bf8-9ad2-f21b1a8adaeb service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:51.692283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c0c92ccd-acfa-4dbf-b46e-a2371c1fa062 req-d594e46b-6fe1-4bf8-9ad2-f21b1a8adaeb service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:51.692704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c0c92ccd-acfa-4dbf-b46e-a2371c1fa062 req-d594e46b-6fe1-4bf8-9ad2-f21b1a8adaeb service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:51.703391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-c0c92ccd-acfa-4dbf-b46e-a2371c1fa062 req-d594e46b-6fe1-4bf8-9ad2-f21b1a8adaeb service nova] Creating event network-vif-plugged:734e6925-ff8f-414a-b2c5-79868183c1ba for instance 15c73035-4140-417b-b820-a1f7ce16e591 on hv-cinder-85391 Aug 25 05:22:51.708372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-c0c92ccd-acfa-4dbf-b46e-a2371c1fa062 req-d594e46b-6fe1-4bf8-9ad2-f21b1a8adaeb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030927 Aug 25 05:22:51.708961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 437/877] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:52.252152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:52.252848 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:52.259346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:52.259815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:52.260242 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:52.260951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:52.261391 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:52.261838 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:52.391953 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:52.400578 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:52.402099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:52.403239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7fce61c0-e04e-4ef8-89ff-5eb2a755d40b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.155529 Aug 25 05:22:52.403786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 441/878] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:52 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:53.426775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:53.427469 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:53.433530 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:53.434031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:53.434457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:53.435132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:53.435575 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:53.436019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:53.569228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:53.577615 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:53.579780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:53.580917 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7dc775b9-e8b8-4e47-89c2-bfb93b560010 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.158879 Aug 25 05:22:53.581475 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 438/879] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:53 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:54.606494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:54.606494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:54.612070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:54.612558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:54.612996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:54.613731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:54.614212 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:54.614636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:54.743487 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:54.751761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:54.753265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:54.754503 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9db29e77-41f7-4c09-a25a-707fa1fb0f35 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1733 microversion: 2.20 time: 0.154331 Aug 25 05:22:54.755063 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 442/880] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:54 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:22:55.734456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:55.737137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:55.743689 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:55.744160 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:55.744584 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:55.745258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:55.745729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:55.746146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:55.777319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d95d3865-95b9-481c-a148-820830e285db tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046715 Aug 25 05:22:55.777578 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:55.778057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 439/881] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:22:55 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:22:55.778997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:55.785341 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:55.785965 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:55.786397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:55.787083 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:55.787525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:55.787921 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:22:55.788029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:55.788433 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:55.794223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:55.794698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:55.795126 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:55.795805 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:55.796248 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:55.796666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:55.825847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-81e2536e-4841-49fd-a54b-99e57dd25997 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/45ba0faa-6de8-4ea8-9203-34a5399fbca7" status: 200 len: 194 microversion: 2.1 time: 0.041394 Aug 25 05:22:55.826363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 440/882] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Aug 25 05:22:55 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/45ba0faa-6de8-4ea8-9203-34a5399fbca7 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:22:55.918562 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:55.927385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:55.928885 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:22:55.930071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-08f670e4-cf48-4219-a7c7-c12b9dec10c1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1720 microversion: 2.20 time: 0.156368 Aug 25 05:22:55.930620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 443/883] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:22:55 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 05:22:57.381931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6df921e4-7b1e-4dad-826d-3663a1d92662"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:22:57.386026 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:22:57.390749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:57.391222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:57.391675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:57.392349 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:22:57.392791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:22:57.393211 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:22:58.088578 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2c3da4e5-7963-416f-aed1-8600fbff00d4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "POST /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710401 Aug 25 05:22:58.089432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 441/884] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:22:57 2022] POST /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:06.646462 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:06.648698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:06.651246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=21 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:06.652070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:06.656731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:06.657202 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:06.657656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:06.658330 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:06.658779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:06.665115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:06.688549 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-62d12147-0149-415d-ac73-f2afb9740f3f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045432 Aug 25 05:23:06.693380 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 444/885] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:23:06 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:06.832759 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:06.833282 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:06.840016 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:06.840488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:06.840912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:06.841582 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:06.842052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:06.842466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:06.870755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-82cf1568-69d9-4b31-9c9a-670abedae802 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/45ba0faa-6de8-4ea8-9203-34a5399fbca7" status: 200 len: 194 microversion: 2.1 time: 0.042958 Aug 25 05:23:06.871425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 442/886] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Aug 25 05:23:06 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/45ba0faa-6de8-4ea8-9203-34a5399fbca7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:06.882476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:06.882973 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:06.889637 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:06.890122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:06.890551 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:06.891916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:06.892370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:06.892796 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:06.974493 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lazy-loading 'services' on Instance uuid 6e0e0019-4497-4587-9bda-8b2f158a8863 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:23:07.157952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-553c69c9-d3e7-4842-aa83-2383deed75e1 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/45ba0faa-6de8-4ea8-9203-34a5399fbca7" status: 202 len: 0 microversion: 2.1 time: 0.279125 Aug 25 05:23:07.158551 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 445/887] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:23:06 2022] DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/45ba0faa-6de8-4ea8-9203-34a5399fbca7 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:23:09.333456 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:09.334060 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:09.340180 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:09.340659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:09.341098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:09.341810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:09.342266 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:09.342701 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:09.371475 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8f720a93-552f-4196-bbee-2244179e2ab4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/6df921e4-7b1e-4dad-826d-3663a1d92662" status: 200 len: 194 microversion: 2.1 time: 0.042058 Aug 25 05:23:09.372058 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 443/888] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Aug 25 05:23:09 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/6df921e4-7b1e-4dad-826d-3663a1d92662 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:09.384009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:09.384649 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:09.390957 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:09.391445 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:09.391872 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:09.392580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:09.393032 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:09.393457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:09.471394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lazy-loading 'services' on Instance uuid 6e0e0019-4497-4587-9bda-8b2f158a8863 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:23:09.705786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d09f9984-4ddd-40f4-b3df-4e9620f4ebff tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/6df921e4-7b1e-4dad-826d-3663a1d92662" status: 202 len: 0 microversion: 2.1 time: 0.326280 Aug 25 05:23:09.706366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 446/889] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:23:09 2022] DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments/6df921e4-7b1e-4dad-826d-3663a1d92662 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:23:11.926708 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:11.929260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:11.931362 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=34 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:11.936092 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:11.937023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:11.937023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:11.938240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:11.938690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:11.939104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:11.942685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:11.968785 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a741c82c-278b-49f5-aa5a-2edadc7507ed tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046022 Aug 25 05:23:11.969855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 444/890] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:23:11 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:23:12.079643 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:12.081899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:12.088231 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:12.088709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:12.089140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:12.089844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:12.090294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:12.090707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:12.120460 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-05ebdf1e-d808-4626-88c7-ce11157bb28e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045637 Aug 25 05:23:12.121008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 447/891] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:23:12 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:23:12.180581 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:12.181075 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:12.188201 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:12.188685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:12.189121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:12.189867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:12.190340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:12.190784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:12.215568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:23:12.511570 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-904810df-b33a-4b1d-a980-3c36aac906fd tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 204 len: 0 microversion: 2.1 time: 0.334525 Aug 25 05:23:12.512165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 445/892] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:12 2022] DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:23:12.520778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:12.521385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:12.527336 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:12.527813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:12.528248 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:12.528935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:12.529379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:12.529836 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:12.656159 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:12.663808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3f0f2c0b-25b3-479e-b530-0288f9559055 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1673 microversion: 2.1 time: 0.146843 Aug 25 05:23:12.664369 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 448/893] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:12 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:13.687382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:13.688110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:13.694477 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:13.694951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:13.695382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:13.696059 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:13.696499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:13.696910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:13.822157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:13.830325 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4d932ab7-5fe5-43ca-be4f-1ccf65a13506 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1673 microversion: 2.1 time: 0.147208 Aug 25 05:23:13.830889 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 446/894] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:13 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:14.851895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:14.852605 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:14.859107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:14.860232 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:14.860666 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:14.861405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:14.861886 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:14.862307 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:14.991921 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:14.999618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-defe9e96-4a78-4995-9d81-39dfe9d4adc5 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1673 microversion: 2.1 time: 0.151861 Aug 25 05:23:15.000512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 449/895] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:14 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:15.680259 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-27abd0e4-ea46-43bf-9c61-101cccdf065d req-bf56e980-903e-433a-8e49-9b54ffd0da3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0e0019-4497-4587-9bda-8b2f158a8863", "name": "network-vif-deleted", "tag": "65bf2c10-1959-4066-8f1f-777c8aeea327"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:15.692130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-27abd0e4-ea46-43bf-9c61-101cccdf065d req-bf56e980-903e-433a-8e49-9b54ffd0da3f service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:15.694352 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-27abd0e4-ea46-43bf-9c61-101cccdf065d req-bf56e980-903e-433a-8e49-9b54ffd0da3f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:15.694352 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-27abd0e4-ea46-43bf-9c61-101cccdf065d req-bf56e980-903e-433a-8e49-9b54ffd0da3f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:15.707627 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-27abd0e4-ea46-43bf-9c61-101cccdf065d req-bf56e980-903e-433a-8e49-9b54ffd0da3f service nova] Creating event network-vif-deleted:65bf2c10-1959-4066-8f1f-777c8aeea327 for instance 6e0e0019-4497-4587-9bda-8b2f158a8863 on hv-cinder-85391 Aug 25 05:23:15.712965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-27abd0e4-ea46-43bf-9c61-101cccdf065d req-bf56e980-903e-433a-8e49-9b54ffd0da3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037042 Aug 25 05:23:15.713573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 447/896] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:16.021423 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:16.022015 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:16.028631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:16.029046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:16.029480 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:16.030207 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:16.030712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:16.031193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:16.062238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:16.063624 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:16.064104 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:16.064548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lazy-loading 'fault' on Instance uuid 6e0e0019-4497-4587-9bda-8b2f158a8863 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:23:16.107786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd61cf1670a7a43519c7258cd467227b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2eb9cdd7b67546ca8eb089247f0a0ce1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:16.116140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0cac132d-53c4-4f8f-a866-4d7286948de4 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 200 len: 1326 microversion: 2.1 time: 0.098612 Aug 25 05:23:16.122582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 450/897] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:16 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:23:17.141280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:17.141997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:17.148579 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:17.149053 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:17.149480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:17.150181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:17.150627 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:17.151042 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:17.313634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] HTTP exception thrown: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Request method failure captured: Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 HTTP/1.1 Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUIarOXh0xAUZnLyeqBisf2u12WIZq7qE4awO6B3Xs-DghRO8QbrsSiXVw2TFPXd5UupGQglehTwIrt6Zxx3EabjU1ScyugIrb_8pegFkkZ7Yi_lScHNgF9rsE3yOcakyWAhDJT-nyomaXar64JX-I8Tu_lnoiuaj2at6UJiicouXk Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:17.315344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2eb9cdd7b67546ca8eb089247f0a0ce1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: d61cf1670a7a43519c7258cd467227b6 Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:17.316896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '6e0e0019-4497-4587-9bda-8b2f158a8863'} Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:17.317900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:17.319511 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:17.320886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Returning 404 to user: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:17.320886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cf7eb449-e76a-4501-933a-fffdbddd3e9b tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 404 len: 111 microversion: 2.1 time: 0.180300 Aug 25 05:23:17.320886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 448/898] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:17 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:17.325534 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f5408502-0d37-408f-a475-6416e2f3da6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '.version_select at 0x7f2423b95b80>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:17.404586 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f5408502-0d37-408f-a475-6416e2f3da6d tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491294545" status: 202 len: 0 microversion: 2.1 time: 0.082704 Aug 25 05:23:17.405081 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 451/899] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Aug 25 05:23:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491294545 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:23:21.184128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:21.184651 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:21.191625 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:21.192103 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:21.192534 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:21.193216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:21.193690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:21.194118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:21.207444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] HTTP exception thrown: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Request method failure captured: Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 HTTP/1.1 Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUIarOXh0xAUZnLyeqBisf2u12WIZq7qE4awO6B3Xs-DghRO8QbrsSiXVw2TFPXd5UupGQglehTwIrt6Zxx3EabjU1ScyugIrb_8pegFkkZ7Yi_lScHNgF9rsE3yOcakyWAhDJT-nyomaXar64JX-I8Tu_lnoiuaj2at6UJiicouXk Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:21.209022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2eb9cdd7b67546ca8eb089247f0a0ce1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: d61cf1670a7a43519c7258cd467227b6 Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.210580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '6e0e0019-4497-4587-9bda-8b2f158a8863'} Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:21.211666 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.213076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.214689 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Returning 404 to user: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:21.214689 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-297aacc1-2405-47cb-a051-9348e02ece2e tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 404 len: 111 microversion: 2.1 time: 0.030068 Aug 25 05:23:21.214689 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 449/900] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:21 2022] DELETE /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:21.221058 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:21.221696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: 6e0e0019-4497-4587-9bda-8b2f158a8863] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:21.228570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:21.229047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:21.229474 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:21.230185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:21.230634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:21.231080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:21.245526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] HTTP exception thrown: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Request method failure captured: Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 HTTP/1.1 Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUIarOXh0xAUZnLyeqBisf2u12WIZq7qE4awO6B3Xs-DghRO8QbrsSiXVw2TFPXd5UupGQglehTwIrt6Zxx3EabjU1ScyugIrb_8pegFkkZ7Yi_lScHNgF9rsE3yOcakyWAhDJT-nyomaXar64JX-I8Tu_lnoiuaj2at6UJiicouXk Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:21.247132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2eb9cdd7b67546ca8eb089247f0a0ce1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: d61cf1670a7a43519c7258cd467227b6 Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '6e0e0019-4497-4587-9bda-8b2f158a8863'} Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:21.249310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. Aug 25 05:23:21.251600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:21.253132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Returning 404 to user: Instance 6e0e0019-4497-4587-9bda-8b2f158a8863 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:21.253132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-55f700c6-c459-4964-b792-b45ddd80994f tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863" status: 404 len: 111 microversion: 2.1 time: 0.032487 Aug 25 05:23:21.253132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 452/901] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:21 2022] GET /compute/v2.1/servers/6e0e0019-4497-4587-9bda-8b2f158a8863 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:22.608161 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:22.608649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:22.614960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:22.615436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:22.615867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:22.616544 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:22.616987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:22.617403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:22.630852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] HTTP exception thrown: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Request method failure captured: Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: DELETE /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc HTTP/1.1 Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUIarOXh0xAUZnLyeqBisf2u12WIZq7qE4awO6B3Xs-DghRO8QbrsSiXVw2TFPXd5UupGQglehTwIrt6Zxx3EabjU1ScyugIrb_8pegFkkZ7Yi_lScHNgF9rsE3yOcakyWAhDJT-nyomaXar64JX-I8Tu_lnoiuaj2at6UJiicouXk Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:22.632392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2eb9cdd7b67546ca8eb089247f0a0ce1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: d61cf1670a7a43519c7258cd467227b6 Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.634008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': 'cc100113-0ca3-4722-b59c-b725c79197cc'} Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:22.635088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.636287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.637556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Returning 404 to user: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:22.637556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e0f478a7-623f-4e95-a8fc-a272a19f88c0 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 404 len: 111 microversion: 2.1 time: 0.029351 Aug 25 05:23:22.637556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 450/902] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:22 2022] DELETE /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:22.642637 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:22.643239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] [instance: cc100113-0ca3-4722-b59c-b725c79197cc] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:22.649489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:22.649992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:22.650419 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:22.651089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:22.651532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:22.651943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:22.665783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] HTTP exception thrown: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Request method failure captured: Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc HTTP/1.1 Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUIarOXh0xAUZnLyeqBisf2u12WIZq7qE4awO6B3Xs-DghRO8QbrsSiXVw2TFPXd5UupGQglehTwIrt6Zxx3EabjU1ScyugIrb_8pegFkkZ7Yi_lScHNgF9rsE3yOcakyWAhDJT-nyomaXar64JX-I8Tu_lnoiuaj2at6UJiicouXk Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:22.667302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2eb9cdd7b67546ca8eb089247f0a0ce1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2eb9cdd7b67546ca8eb089247f0a0ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 2eb9cdd7b67546ca8eb089247f0a0ce1 Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1996819337 Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: d61cf1670a7a43519c7258cd467227b6 Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeTestJSON-1996819337-project Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.668817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'cc100113-0ca3-4722-b59c-b725c79197cc'} Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:22.669695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. Aug 25 05:23:22.671182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:22.673199 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] Returning 404 to user: Instance cc100113-0ca3-4722-b59c-b725c79197cc could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:22.673199 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e8882d1f-b5eb-4f90-8575-0358c2439316 tempest-AttachVolumeTestJSON-1996819337 tempest-AttachVolumeTestJSON-1996819337-project] 10.222.0.16 "GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc" status: 404 len: 111 microversion: 2.1 time: 0.030508 Aug 25 05:23:22.673199 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 453/903] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:22 2022] GET /compute/v2.1/servers/cc100113-0ca3-4722-b59c-b725c79197cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:28.299919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-91457f50-0434-4f9a-8848-a5df1b769610 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Action: 'create', calling method: .version_select at 0x7f2423a0fdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-332324624"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:29.108486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-91457f50-0434-4f9a-8848-a5df1b769610 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.919480 Aug 25 05:23:29.109108 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 451/904] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Aug 25 05:23:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 921 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 05:23:29.121472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-13f2733b-8024-448e-97b8-c9ebe6cb5ad9 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423cab160>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:29.223791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-13f2733b-8024-448e-97b8-c9ebe6cb5ad9 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6" status: 200 len: 344 microversion: 2.1 time: 0.102302 Aug 25 05:23:29.223791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 454/905] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:23:29 2022] GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:30.234324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0282c643-12c4-4e9f-8e23-50c823380476 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423a83790>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:30.281545 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0282c643-12c4-4e9f-8e23-50c823380476 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6" status: 200 len: 345 microversion: 2.1 time: 0.051530 Aug 25 05:23:30.282134 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 452/906] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:23:30 2022] GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:30.294684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-07579e3c-6b58-43f6-93f8-05e475bf5a38 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Action: 'create', calling method: .version_select at 0x7f2423eb2af0>, body: {"snapshot": {"volume_id": "9682eb07-e979-489b-86a5-43d0062d64a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2143684697"}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:30.764765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-07579e3c-6b58-43f6-93f8-05e475bf5a38 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.474284 Aug 25 05:23:30.765418 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 455/907] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Aug 25 05:23:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:30.775836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e9b8ebdf-f081-443c-a2f7-e750bbd4d56d tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423984ca0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:30.805478 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e9b8ebdf-f081-443c-a2f7-e750bbd4d56d tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 287 microversion: 2.1 time: 0.033338 Aug 25 05:23:30.806165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 453/908] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:30 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:30.816646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6101d672-e508-4160-b486-69933c1ce067 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423c4e5e0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:30.850651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6101d672-e508-4160-b486-69933c1ce067 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037467 Aug 25 05:23:30.851302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 456/909] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Aug 25 05:23:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:30.862470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8996a1cd-4259-403b-815c-e5ad63f191cf tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423a3a4c0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:30.892297 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8996a1cd-4259-403b-815c-e5ad63f191cf tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 287 microversion: 2.1 time: 0.033020 Aug 25 05:23:30.892897 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 454/910] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:30 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:23:31.904738 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8357bb48-56fe-4686-85d2-34f1c7f06a0f tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423b95f70>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:31.934196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8357bb48-56fe-4686-85d2-34f1c7f06a0f tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 287 microversion: 2.1 time: 0.033801 Aug 25 05:23:31.934744 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 457/911] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:31 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:32.950392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:32.951149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:32.955491 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c7508fea-0ecb-4973-890e-0dfe483f0b93 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423b9d0d0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:32.984516 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c7508fea-0ecb-4973-890e-0dfe483f0b93 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 287 microversion: 2.1 time: 0.035485 Aug 25 05:23:32.985076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 455/912] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:32 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:33.399162 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:33.399914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:33.404254 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:33.404741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:33.411695 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:33.412205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:33.412634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:33.413344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:33.413829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:33.414252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:33.437180 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-31c50519-5028-46ce-b805-6162ad45f4c9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/ips" status: 200 len: 149 microversion: 2.1 time: 0.038821 Aug 25 05:23:33.440743 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 458/913] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:23:33 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:33.997486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b0afe151-27dc-4fa6-a8db-182efffbba70 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f24239845e0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:34.027295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b0afe151-27dc-4fa6-a8db-182efffbba70 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 287 microversion: 2.1 time: 0.034576 Aug 25 05:23:34.028031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 456/914] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:33 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:35.040305 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-375ba971-7045-4254-860a-8092cd3408f6 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f24239cd1f0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:35.071026 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-375ba971-7045-4254-860a-8092cd3408f6 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 287 microversion: 2.1 time: 0.034886 Aug 25 05:23:35.071582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 459/915] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:35 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:36.084411 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3de2b6d6-47d9-4fac-bf52-211ef72598cc tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423b9d820>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:36.115067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3de2b6d6-47d9-4fac-bf52-211ef72598cc tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 288 microversion: 2.1 time: 0.034850 Aug 25 05:23:36.115624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 457/916] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:36 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:36.133699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-862a56ec-dfdc-4d70-a154-c1d796c63df6 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423cabdc0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:36.203611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a54ed8a-3970-4bab-af24-1a553dd5cedb"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:36.206868 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:36.212876 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:36.213346 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:36.213803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:36.214553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:36.214922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:36.215337 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:36.285324 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-862a56ec-dfdc-4d70-a154-c1d796c63df6 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 202 len: 0 microversion: 2.1 time: 0.156358 Aug 25 05:23:36.285943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 460/917] 10.222.0.16 () {58 vars in 1254 bytes} [Thu Aug 25 05:23:36 2022] DELETE /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:23:36.294288 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fe0b2a92-addd-4d2b-b4ce-7bd173416d7e tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423c98af0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:36.325365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fe0b2a92-addd-4d2b-b4ce-7bd173416d7e tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 200 len: 287 microversion: 2.1 time: 0.035002 Aug 25 05:23:36.326322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 461/918] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:36 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:23:37.339614 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a4cad574-5a95-4c6f-96df-83983c84aaa9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "POST /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.140420 Aug 25 05:23:37.340121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4fbe9e59-f8f3-46bc-a464-1b4656626f47 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f24239cd700>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:37.340546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 458/919] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:23:36 2022] POST /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments => generated 194 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:23:37.374959 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-4fbe9e59-f8f3-46bc-a464-1b4656626f47 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] HTTP exception thrown: Snapshot d8ef5197-1418-43c4-98c4-a4bf3ed9627a could not be found. Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4fbe9e59-f8f3-46bc-a464-1b4656626f47 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Request method failure captured: Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a HTTP/1.1 Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwdQ91fJZTT6QV6-ImoUJXfDBZ6rg3vGhJDpEGGqiu81Ot9HispAK9H0yDmVU0MX392L-55gLqimIgyRMIgpRNEczzsWMa2QxMmdtSGribdMKBOmK3o5ailWH7jKWrZfTe_LR4Uu1pvLVNRd65NXe3BCRgWTSN_aKsYxve9FMPPbdCQ Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:37.377467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_640ceaf94d5445c681e5b5f29eadb0df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: dadcc8220f9c448fb9418a311029aaf7 Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Snapshot d8ef5197-1418-43c4-98c4-a4bf3ed9627a could not be found. Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'd8ef5197-1418-43c4-98c4-a4bf3ed9627a'} Aug 25 05:23:37.379109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d8ef5197-1418-43c4-98c4-a4bf3ed9627a could not be found. (HTTP 404) (Request-ID: req-9e4ec6fc-9c0b-40c7-b371-a09c29a7b917) Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:37.380114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:23:37.382033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d8ef5197-1418-43c4-98c4-a4bf3ed9627a could not be found. Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 25 05:23:37.383750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d8ef5197-1418-43c4-98c4-a4bf3ed9627a could not be found. Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d8ef5197-1418-43c4-98c4-a4bf3ed9627a could not be found. Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4fbe9e59-f8f3-46bc-a464-1b4656626f47 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Returning 404 to user: Snapshot d8ef5197-1418-43c4-98c4-a4bf3ed9627a could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:37.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4fbe9e59-f8f3-46bc-a464-1b4656626f47 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a" status: 404 len: 111 microversion: 2.1 time: 0.044637 Aug 25 05:23:37.386214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 462/920] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Aug 25 05:23:37 2022] GET /compute/v2.1/os-snapshots/d8ef5197-1418-43c4-98c4-a4bf3ed9627a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:23:37.389262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-428ec4cd-715f-44ae-8d1d-bd0502792d18 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423b98a60>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:37.662172 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-428ec4cd-715f-44ae-8d1d-bd0502792d18 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6" status: 202 len: 0 microversion: 2.1 time: 0.277378 Aug 25 05:23:37.662775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 459/921] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:23:37 2022] DELETE /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:23:37.670910 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ffcef4d9-3530-492e-95a9-748b4bc36ebc tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423c98820>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:37.717932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ffcef4d9-3530-492e-95a9-748b4bc36ebc tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6" status: 200 len: 344 microversion: 2.1 time: 0.050737 Aug 25 05:23:37.718494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 463/922] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:23:37 2022] GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:38.732672 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d47292e3-bab1-4466-bc24-50f7e4dff216 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423a0f310>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:38.760559 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-d47292e3-bab1-4466-bc24-50f7e4dff216 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] HTTP exception thrown: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d47292e3-bab1-4466-bc24-50f7e4dff216 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Request method failure captured: Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 HTTP/1.1 Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwdQ91fJZTT6QV6-ImoUJXfDBZ6rg3vGhJDpEGGqiu81Ot9HispAK9H0yDmVU0MX392L-55gLqimIgyRMIgpRNEczzsWMa2QxMmdtSGribdMKBOmK3o5ailWH7jKWrZfTe_LR4Uu1pvLVNRd65NXe3BCRgWTSN_aKsYxve9FMPPbdCQ Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:38.762694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_640ceaf94d5445c681e5b5f29eadb0df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: dadcc8220f9c448fb9418a311029aaf7 Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '9682eb07-e979-489b-86a5-43d0062d64a6'} Aug 25 05:23:38.764251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. (HTTP 404) (Request-ID: req-6085667d-4435-445b-b643-d0ea689dd593) Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.765174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:23:38.766631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 05:23:38.767979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d47292e3-bab1-4466-bc24-50f7e4dff216 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Returning 404 to user: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d47292e3-bab1-4466-bc24-50f7e4dff216 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6" status: 404 len: 109 microversion: 2.1 time: 0.035851 Aug 25 05:23:38.769514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 460/923] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:23:38 2022] GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:38.778436 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9f687bec-b0a0-4d80-ae9c-9c2275837730 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423cab1f0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:38.807727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-9f687bec-b0a0-4d80-ae9c-9c2275837730 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] HTTP exception thrown: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9f687bec-b0a0-4d80-ae9c-9c2275837730 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Request method failure captured: Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 HTTP/1.1 Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwdQ91fJZTT6QV6-ImoUJXfDBZ6rg3vGhJDpEGGqiu81Ot9HispAK9H0yDmVU0MX392L-55gLqimIgyRMIgpRNEczzsWMa2QxMmdtSGribdMKBOmK3o5ailWH7jKWrZfTe_LR4Uu1pvLVNRd65NXe3BCRgWTSN_aKsYxve9FMPPbdCQ Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:38.809679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_640ceaf94d5445c681e5b5f29eadb0df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: dadcc8220f9c448fb9418a311029aaf7 Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '9682eb07-e979-489b-86a5-43d0062d64a6'} Aug 25 05:23:38.811126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. (HTTP 404) (Request-ID: req-930ee4de-d1e1-4692-b4ee-a4ec016c5e5b) Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.814801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 05:23:38.815942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 05:23:38.817290 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9f687bec-b0a0-4d80-ae9c-9c2275837730 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Returning 404 to user: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9f687bec-b0a0-4d80-ae9c-9c2275837730 tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6" status: 404 len: 109 microversion: 2.1 time: 0.036863 Aug 25 05:23:38.818653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 464/924] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Aug 25 05:23:38 2022] DELETE /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:38.819720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-05c06bce-93b9-40ab-9962-de171db74f0f tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Calling method '.version_select at 0x7f2423984c10>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:38.847108 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-05c06bce-93b9-40ab-9962-de171db74f0f tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] HTTP exception thrown: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-05c06bce-93b9-40ab-9962-de171db74f0f tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Request method failure captured: Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 HTTP/1.1 Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwdQ91fJZTT6QV6-ImoUJXfDBZ6rg3vGhJDpEGGqiu81Ot9HispAK9H0yDmVU0MX392L-55gLqimIgyRMIgpRNEczzsWMa2QxMmdtSGribdMKBOmK3o5ailWH7jKWrZfTe_LR4Uu1pvLVNRd65NXe3BCRgWTSN_aKsYxve9FMPPbdCQ Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:38.849314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_640ceaf94d5445c681e5b5f29eadb0df", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/640ceaf94d5445c681e5b5f29eadb0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 640ceaf94d5445c681e5b5f29eadb0df Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1198084139 Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: dadcc8220f9c448fb9418a311029aaf7 Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1198084139-project Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '9682eb07-e979-489b-86a5-43d0062d64a6'} Aug 25 05:23:38.850870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. (HTTP 404) (Request-ID: req-bcc44146-af28-4f82-a852-042ad5d4c749) Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.851839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 05:23:38.853236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 05:23:38.854675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-05c06bce-93b9-40ab-9962-de171db74f0f tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] Returning 404 to user: Volume 9682eb07-e979-489b-86a5-43d0062d64a6 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-05c06bce-93b9-40ab-9962-de171db74f0f tempest-VolumesSnapshotsTestJSON-1198084139 tempest-VolumesSnapshotsTestJSON-1198084139-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6" status: 404 len: 109 microversion: 2.1 time: 0.035105 Aug 25 05:23:38.856039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 461/925] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Aug 25 05:23:38 2022] GET /compute/v2.1/os-volumes/9682eb07-e979-489b-86a5-43d0062d64a6 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:23:46.044324 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:46.049757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:46.050256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:46.056132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:46.056612 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:46.057047 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:46.057808 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:46.058394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:46.058817 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:46.142791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lazy-loading 'services' on Instance uuid e13c1236-a24c-478a-ac43-a1035b100bd5 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:23:46.375122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d1df96e8-936e-4bb3-b3c0-b718757b7f41 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments/2a54ed8a-3970-4bab-af24-1a553dd5cedb" status: 202 len: 0 microversion: 2.1 time: 0.331771 Aug 25 05:23:46.376165 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 465/926] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:23:46 2022] DELETE /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments/2a54ed8a-3970-4bab-af24-1a553dd5cedb => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:23:46.383145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:23:46.387970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:46.390352 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:46.396441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:46.396922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:46.397358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:46.398090 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:46.398541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:46.398966 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:46.429244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8f406330-00b4-444a-98e7-1f75f038c625 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048345 Aug 25 05:23:46.429838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 462/927] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:23:46 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:47.443022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:47.446257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:47.452498 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:47.453183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:47.453676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:47.454381 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:47.454901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:47.455346 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:47.485236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f26e8c49-26b5-48dc-ab06-3a110699a909 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047088 Aug 25 05:23:47.492906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 466/928] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:23:47 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:48.498107 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:48.500311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:48.506752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:48.507231 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:48.507660 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:48.508467 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:48.508788 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:48.509206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:48.539753 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4ded0126-bef0-4f8c-8381-e4ef1bd68c42 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045971 Aug 25 05:23:48.546992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 463/929] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:23:48 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:23:48.602974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:48.603503 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:48.610018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:48.610509 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:48.612347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:48.614424 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:48.614424 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:48.614654 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:48.641118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:23:48.971147 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fb81c85c-29e3-44e2-8edc-a9fd9b920947 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 204 len: 0 microversion: 2.1 time: 0.373049 Aug 25 05:23:48.973367 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 467/930] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:48 2022] DELETE /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:23:48.981540 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:48.982179 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:48.988197 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:48.988713 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:48.989322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:48.990210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:48.990812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:48.991383 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:49.130884 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:49.139473 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-aa70fb37-b2b8-42ff-8d9b-ed9003da8901 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1681 microversion: 2.1 time: 0.162088 Aug 25 05:23:49.140034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 464/931] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:48 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:50.162398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:50.163124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:50.169559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:50.170113 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:50.170544 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:50.171224 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:50.171672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:50.172110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:50.298858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:50.307190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7733202b-7619-475d-86e9-b294b4e5c598 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1681 microversion: 2.1 time: 0.149648 Aug 25 05:23:50.307758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 468/932] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:50 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:51.327571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:51.328182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:51.335620 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:51.336128 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:51.336559 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:51.337245 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:51.337716 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:51.338130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:51.600634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:51.608258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5ae967cc-190b-4cfd-809e-879ea81f1a2d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1681 microversion: 2.1 time: 0.284536 Aug 25 05:23:51.608822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 465/933] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:51 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:51.976416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1277451326", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "networks": [{"uuid": "e49da47a-f1e4-484e-87dc-9a576ec5b8c0"}]}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:52.033008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] validate_networks() for [('e49da47a-f1e4-484e-87dc-9a576ec5b8c0', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:23:52.217310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-c32bada8-cf2c-4c40-bedb-ccd2b6c778fb req-3d36b281-35ed-4b2e-9784-1463f8a226a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13c1236-a24c-478a-ac43-a1035b100bd5", "name": "network-vif-deleted", "tag": "b3efd045-f9cf-4456-a70e-5318feee2f25"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:52.228008 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c32bada8-cf2c-4c40-bedb-ccd2b6c778fb req-3d36b281-35ed-4b2e-9784-1463f8a226a0 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:52.228481 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c32bada8-cf2c-4c40-bedb-ccd2b6c778fb req-3d36b281-35ed-4b2e-9784-1463f8a226a0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:52.228905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-c32bada8-cf2c-4c40-bedb-ccd2b6c778fb req-3d36b281-35ed-4b2e-9784-1463f8a226a0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:52.240433 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-c32bada8-cf2c-4c40-bedb-ccd2b6c778fb req-3d36b281-35ed-4b2e-9784-1463f8a226a0 service nova] Creating event network-vif-deleted:b3efd045-f9cf-4456-a70e-5318feee2f25 for instance e13c1236-a24c-478a-ac43-a1035b100bd5 on hv-cinder-85391 Aug 25 05:23:52.245455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-c32bada8-cf2c-4c40-bedb-ccd2b6c778fb req-3d36b281-35ed-4b2e-9784-1463f8a226a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031765 Aug 25 05:23:52.246087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 466/934] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:52.427544 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:23:52.427961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:23:52.428433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:23:52.429042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:23:52.429454 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:23:52.439531 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:52.440035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:52.440454 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:52.441769 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:52.442219 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:52.442646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:52.461731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Getting quotas for project aed82d3b5299415ca1e2e3cfcb7e2d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:23:52.470149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Getting quotas for user 6a4136b08cc1464eac6c779652a1d2b1 and project aed82d3b5299415ca1e2e3cfcb7e2d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:23:52.486737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:23:52.489170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:23:52.623104 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c0847dc2-4511-4594-bfbc-4a51b60fe815 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650863 Aug 25 05:23:52.624392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 469/935] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:23:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:23:52.631861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:52.633173 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:52.636871 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-18559c2b-c6b9-471a-a61e-471adb9a59dd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:52.648809 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:52.649293 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:52.649987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:52.650848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:52.651519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:52.651694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:52.651865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-18559c2b-c6b9-471a-a61e-471adb9a59dd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:52.688627 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:52.689770 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:52.690502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:52.691597 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lazy-loading 'fault' on Instance uuid e13c1236-a24c-478a-ac43-a1035b100bd5 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:23:52.724816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-18559c2b-c6b9-471a-a61e-471adb9a59dd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:52.734071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-18559c2b-c6b9-471a-a61e-471adb9a59dd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1219 microversion: 2.1 time: 0.102608 Aug 25 05:23:52.745793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 470/936] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:52 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:52.756686 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec39d995899c4d43bb4f8ffd9e6d2ef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f640cb592ed1455a827976752ce2f49d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:52.765676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-31742e0b-f4ef-465d-90c2-f91b9f19135c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 200 len: 1331 microversion: 2.1 time: 0.140321 Aug 25 05:23:52.780797 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 467/937] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:52 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:23:53.755331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:53.755940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:53.762252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:53.762736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:53.763153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:53.763825 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:53.764265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:53.764678 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:53.788313 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:53.788997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:53.795603 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:53.800873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:53.800873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:53.800873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:53.800873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:53.801427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:53.813246 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 HTTP/1.1 Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:53.815097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:53.816696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': 'e13c1236-a24c-478a-ac43-a1035b100bd5'} Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:53.817536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:53.819015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:53.820211 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:53.820211 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-086740dd-e566-400f-b075-4223b38bb8b9 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 404 len: 111 microversion: 2.1 time: 0.032789 Aug 25 05:23:53.820211 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 468/938] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:53 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:53.825226 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3b29ee8e-bd9f-4105-b52a-10c605be5fb6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '.version_select at 0x7f2423b9d1f0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:53.826539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:53.834513 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f1cf7161-b489-42ba-bcc0-94514323e6e6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1223 microversion: 2.1 time: 0.083411 Aug 25 05:23:53.835095 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 471/939] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:53 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:53.913707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3b29ee8e-bd9f-4105-b52a-10c605be5fb6 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-715153154" status: 202 len: 0 microversion: 2.1 time: 0.091955 Aug 25 05:23:53.914295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 469/940] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Aug 25 05:23:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-715153154 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:23:54.855942 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:54.856582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:54.863354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:54.863843 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:54.864279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:54.864981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:54.865553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:54.866001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:54.933126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:54.942612 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-237f7c00-fa9e-4974-a2db-1ee9ebf9c79b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1271 microversion: 2.1 time: 0.090569 Aug 25 05:23:54.943421 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 472/941] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:54 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:55.964825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:55.965441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:55.972765 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:55.973502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:55.973962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:55.974636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:55.975081 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:55.975500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:56.028240 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:56.028752 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:56.035599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:56.036230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:56.036660 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:56.041565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:56.041565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:56.041565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:56.053045 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 HTTP/1.1 Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:56.054809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.056374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'e13c1236-a24c-478a-ac43-a1035b100bd5'} Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:56.057233 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.058697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.060156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:56.060156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-605288db-4f9c-4b77-8a28-f1952f67998c tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 404 len: 111 microversion: 2.1 time: 0.033810 Aug 25 05:23:56.060156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 473/942] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:56 2022] DELETE /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:23:56.067632 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:56.068238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: e13c1236-a24c-478a-ac43-a1035b100bd5] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:56.074561 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:56.075051 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:56.075471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:56.076279 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:56.076721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:56.077238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:56.091104 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 HTTP/1.1 Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:56.092622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.095100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'e13c1236-a24c-478a-ac43-a1035b100bd5'} Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:56.096012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. Aug 25 05:23:56.098356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:56.099468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance e13c1236-a24c-478a-ac43-a1035b100bd5 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:56.099468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2df5dc7f-dbfb-4c91-8753-cee834f280cb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5" status: 404 len: 111 microversion: 2.1 time: 0.030258 Aug 25 05:23:56.099468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 474/943] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:56 2022] GET /compute/v2.1/servers/e13c1236-a24c-478a-ac43-a1035b100bd5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:56.160243 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:56.167901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-659267ac-b1a0-4669-8363-26cf59daa927 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.207462 Aug 25 05:23:56.175749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 470/944] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:55 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:56.785708 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-64f91c44-28cc-4600-bcfa-a2b1c29c2620 req-9f1d7cf4-f9f8-4e7d-ae6f-c1389bf0fc00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08b426c-39ad-464b-8924-a915541a804a", "tag": "3da211dd-640d-4862-9c7a-cd29f2a0c659"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:23:56.795220 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-64f91c44-28cc-4600-bcfa-a2b1c29c2620 req-9f1d7cf4-f9f8-4e7d-ae6f-c1389bf0fc00 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:56.795744 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-64f91c44-28cc-4600-bcfa-a2b1c29c2620 req-9f1d7cf4-f9f8-4e7d-ae6f-c1389bf0fc00 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:56.800606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-64f91c44-28cc-4600-bcfa-a2b1c29c2620 req-9f1d7cf4-f9f8-4e7d-ae6f-c1389bf0fc00 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:56.809618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-64f91c44-28cc-4600-bcfa-a2b1c29c2620 req-9f1d7cf4-f9f8-4e7d-ae6f-c1389bf0fc00 service nova] Creating event network-changed:3da211dd-640d-4862-9c7a-cd29f2a0c659 for instance a08b426c-39ad-464b-8924-a915541a804a on hv-cinder-85391 Aug 25 05:23:56.814618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-64f91c44-28cc-4600-bcfa-a2b1c29c2620 req-9f1d7cf4-f9f8-4e7d-ae6f-c1389bf0fc00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Aug 25 05:23:56.815206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 475/945] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:23:57.189433 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:57.190268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:57.197509 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.198052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.198529 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.199213 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.199661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.200081 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.431875 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:57.436022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:57.437222 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:57.439784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-82b2f767-db04-4d8d-b790-50e4c1a930af tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.254288 Aug 25 05:23:57.440918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 471/946] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:57 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:57.443986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.444652 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.445082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.445815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.446253 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.446869 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.460255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f HTTP/1.1 Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:57.461922 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.463229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '940baae4-f323-4807-87d4-f556d88e3e8f'} Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:57.464107 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.465295 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.466577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:57.466577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-057ba5be-228a-4b6d-9a13-a74af6e0909b tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 404 len: 111 microversion: 2.1 time: 0.032274 Aug 25 05:23:57.466577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 476/947] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:57 2022] DELETE /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:23:57.472457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:57.473454 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 940baae4-f323-4807-87d4-f556d88e3e8f] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:57.479380 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.479855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.480283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.480967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.481410 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.481875 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.497384 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f HTTP/1.1 Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:57.498956 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.500517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '940baae4-f323-4807-87d4-f556d88e3e8f'} Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:57.501342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. Aug 25 05:23:57.502649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.503773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance 940baae4-f323-4807-87d4-f556d88e3e8f could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:57.503773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-35ceaca4-18f2-4527-8ab4-6a9d12204d0d tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f" status: 404 len: 111 microversion: 2.1 time: 0.032282 Aug 25 05:23:57.503773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 472/948] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:57 2022] GET /compute/v2.1/servers/940baae4-f323-4807-87d4-f556d88e3e8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:57.509156 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:57.509661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:57.515674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.516145 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.516569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.517241 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.517706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.518117 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.531177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 HTTP/1.1 Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:57.532703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.534804 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'bcf9300a-25b9-43ef-929f-cdc1eb6542d9'} Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:57.535759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.537268 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.538876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:57.538876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7adf05fe-39fe-4168-ac0f-a8ce56a6ad34 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 404 len: 111 microversion: 2.1 time: 0.028847 Aug 25 05:23:57.538876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 477/949] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:57 2022] DELETE /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:57.544076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:57.544882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: bcf9300a-25b9-43ef-929f-cdc1eb6542d9] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:57.551522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.552002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.552605 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.553341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:57.553834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:57.554255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:57.567386 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 HTTP/1.1 Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:57.568901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.570600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': 'bcf9300a-25b9-43ef-929f-cdc1eb6542d9'} Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:57.571442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. Aug 25 05:23:57.572859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:57.574167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance bcf9300a-25b9-43ef-929f-cdc1eb6542d9 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:57.574167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bc841966-e8be-47c5-af86-02903af6eaeb tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9" status: 404 len: 111 microversion: 2.1 time: 0.030023 Aug 25 05:23:57.574167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 473/950] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:57 2022] GET /compute/v2.1/servers/bcf9300a-25b9-43ef-929f-cdc1eb6542d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:58.461337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:58.461994 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:58.468529 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:58.469012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:58.469437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:58.470143 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:58.470587 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:58.475601 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:58.600217 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:58.608136 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0ad58520-a189-4fb2-a04e-e7f06a200c43 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.150670 Aug 25 05:23:58.608689 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 478/951] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:58 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:58.992187 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:58.992673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:58.999430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:58.999903 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.000332 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.001009 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.001457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.001898 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.015762 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: DELETE /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 HTTP/1.1 Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:23:59.017280 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.018820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '6a769edb-35d4-41ea-866f-3eb74f13e938'} Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:59.019687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.021198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.022608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:59.022608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2520b835-ab4b-41a1-b1b4-f7be63eb468f tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 404 len: 111 microversion: 2.1 time: 0.030911 Aug 25 05:23:59.022608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 474/952] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:23:58 2022] DELETE /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:59.027377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:59.028013 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] [instance: 6a769edb-35d4-41ea-866f-3eb74f13e938] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:59.033990 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.034969 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.035394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.036069 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.036544 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.036958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.049761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] HTTP exception thrown: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Request method failure captured: Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 HTTP/1.1 Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUAhRKET3T8KHsUtsPacZBH4BFVUaiWDFu-Y3a0EaKbgIgkP0KVAqKKr9AgDT8RU86-LPfT0waRTfCzuQvqT4m2yICKP7MkZZ55o3z_KpQHba_Bk5s9qo0cOyaZkvdWWj5Iy9ySlsR2SxQzFbgNktiZK3HPYOXpYtlS5DlyLBYmJGA Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:23:59.051868 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f640cb592ed1455a827976752ce2f49d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f640cb592ed1455a827976752ce2f49d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: f640cb592ed1455a827976752ce2f49d Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1614497640 Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: ec39d995899c4d43bb4f8ffd9e6d2ef3 Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeNegativeTest-1614497640-project Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.053415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '6a769edb-35d4-41ea-866f-3eb74f13e938'} Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:23:59.054310 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. Aug 25 05:23:59.055791 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:23:59.057071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] Returning 404 to user: Instance 6a769edb-35d4-41ea-866f-3eb74f13e938 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:23:59.057071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a33434c3-1743-429c-8133-e07ebdf14ba0 tempest-AttachVolumeNegativeTest-1614497640 tempest-AttachVolumeNegativeTest-1614497640-project] 10.222.0.16 "GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938" status: 404 len: 111 microversion: 2.1 time: 0.029694 Aug 25 05:23:59.057071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 479/953] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:59 2022] GET /compute/v2.1/servers/6a769edb-35d4-41ea-866f-3eb74f13e938 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:23:59.629120 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:59.629841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:59.635703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.636179 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.636661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.637347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.637827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.638244 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.748540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:59.750989 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:59.757578 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.758245 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.758747 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.759514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.760037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.760554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.790329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-09c2fec1-d0b9-4301-997b-b3a329d998b1 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045763 Aug 25 05:23:59.791013 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 480/954] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Aug 25 05:23:59 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:23:59.840002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:23:59.848703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-29b5ba68-04c2-487a-81e1-3d14650ef5f0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.224056 Aug 25 05:23:59.853239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:23:59.853684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:23:59.859542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.860065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.860500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.860818 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 475/955] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:23:59 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:23:59.861197 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:23:59.861680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:23:59.862105 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:23:59.887108 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:24:00.199590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-70fb8cda-00eb-4bd2-9b43-9575c90c4813 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 204 len: 0 microversion: 2.20 time: 0.349635 Aug 25 05:24:00.201240 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 481/956] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Aug 25 05:23:59 2022] DELETE /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:24:00.209117 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:00.210326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:00.216772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:00.217247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:00.217881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:00.218580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:00.219041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:00.219452 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:00.439965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:00.448322 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:00.449841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:00.451049 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-644fbb23-3f0f-478b-993f-6599e2d9925e tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.245867 Aug 25 05:24:00.451602 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 476/957] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:24:00 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:00.870185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:00.870883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:00.877516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:00.878029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:00.878451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:00.879133 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:00.879573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:00.879987 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:00.898723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:01.018303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:01.027179 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3c28aecd-8338-4a1c-bc2c-d886db3c090f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.161185 Aug 25 05:24:01.028708 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 482/958] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:24:00 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:24:01.473867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:01.474700 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:01.480835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:01.481315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:01.481774 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:01.482459 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:01.482900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:01.483319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:01.616651 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:01.625294 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:01.626979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:01.628796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c7916d3a-8596-4838-b7f4-997860267780 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.158535 Aug 25 05:24:01.630110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 477/959] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:24:01 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:02.048915 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:02.050337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:02.057773 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:02.058392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:02.058924 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:02.059726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:02.060271 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:02.060809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:02.239544 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:02.250537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c5543d40-6fa3-48db-9997-e077b7525ce3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.205947 Aug 25 05:24:02.251120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 483/960] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:24:02 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:24:02.653312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:02.653942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:02.661193 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:02.661698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:02.662326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:02.663228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:02.663842 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:02.664425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:02.848478 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:02.859746 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:02.863367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:02.864688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4a716219-a326-4a14-b5da-a3fd2a8d17be tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1726 microversion: 2.20 time: 0.215158 Aug 25 05:24:02.865457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 478/961] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:24:02 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1726 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:03.206317 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-659d3c82-f1d5-410e-b248-42807460acd0 req-1a4843fd-743a-4031-a74c-21706582471d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c73035-4140-417b-b820-a1f7ce16e591", "name": "network-vif-deleted", "tag": "734e6925-ff8f-414a-b2c5-79868183c1ba"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:03.212935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:03.213874 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=8 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:03.229221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-659d3c82-f1d5-410e-b248-42807460acd0 req-1a4843fd-743a-4031-a74c-21706582471d service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:03.232887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-659d3c82-f1d5-410e-b248-42807460acd0 req-1a4843fd-743a-4031-a74c-21706582471d service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:03.232887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-659d3c82-f1d5-410e-b248-42807460acd0 req-1a4843fd-743a-4031-a74c-21706582471d service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:03.243366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-659d3c82-f1d5-410e-b248-42807460acd0 req-1a4843fd-743a-4031-a74c-21706582471d service nova] Creating event network-vif-deleted:734e6925-ff8f-414a-b2c5-79868183c1ba for instance 15c73035-4140-417b-b820-a1f7ce16e591 on hv-cinder-85391 Aug 25 05:24:03.248711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-659d3c82-f1d5-410e-b248-42807460acd0 req-1a4843fd-743a-4031-a74c-21706582471d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046424 Aug 25 05:24:03.249897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 484/962] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:03.290166 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:03.291629 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:03.300141 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:03.310829 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:03.311621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:03.312594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:03.313247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:03.314486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:03.515601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:03.523560 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5e1ecb58-c911-4db6-93d6-ec6631194e7e tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.256305 Aug 25 05:24:03.524279 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 479/963] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:24:03 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:24:03.890240 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:03.891008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:03.899606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:03.900141 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:03.900612 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:03.901299 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:03.901958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:03.902538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:03.935394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:03.935874 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:03.936291 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:03.936727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lazy-loading 'fault' on Instance uuid 15c73035-4140-417b-b820-a1f7ce16e591 {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:24:03.996377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:04.005523 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:04.007256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3326fcf3ccbc4a978e9e52e25456ad98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcd7d2bdaffb4d168f27cf6444e005dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:04.008596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e07a24a2-b070-4f9f-af3b-b0276762cb4b tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 200 len: 1372 microversion: 2.20 time: 0.122530 Aug 25 05:24:04.009303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 485/964] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:24:03 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 05:24:04.335748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-fc7256f3-6aaf-4cc6-8318-1501b9cf5a95 req-e40696c8-e0b2-4dc5-b9d9-fc43a9208e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08b426c-39ad-464b-8924-a915541a804a", "name": "network-vif-plugged", "status": "completed", "tag": "3da211dd-640d-4862-9c7a-cd29f2a0c659"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:04.348423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-fc7256f3-6aaf-4cc6-8318-1501b9cf5a95 req-e40696c8-e0b2-4dc5-b9d9-fc43a9208e29 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:04.348891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-fc7256f3-6aaf-4cc6-8318-1501b9cf5a95 req-e40696c8-e0b2-4dc5-b9d9-fc43a9208e29 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:04.349574 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-fc7256f3-6aaf-4cc6-8318-1501b9cf5a95 req-e40696c8-e0b2-4dc5-b9d9-fc43a9208e29 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:04.353944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:04.361180 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-fc7256f3-6aaf-4cc6-8318-1501b9cf5a95 req-e40696c8-e0b2-4dc5-b9d9-fc43a9208e29 service nova] Creating event network-vif-plugged:3da211dd-640d-4862-9c7a-cd29f2a0c659 for instance a08b426c-39ad-464b-8924-a915541a804a on hv-cinder-85391 Aug 25 05:24:04.367345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-fc7256f3-6aaf-4cc6-8318-1501b9cf5a95 req-e40696c8-e0b2-4dc5-b9d9-fc43a9208e29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035165 Aug 25 05:24:04.367960 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 480/965] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:24:04.545153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:04.545634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:04.552173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:04.552723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:04.553349 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:04.554066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:04.554512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:04.554929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:04.700807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:04.709207 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a19f5567-5a65-4c61-9197-e71abecaf779 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.168627 Aug 25 05:24:04.710043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 486/966] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:24:04 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:24:05.033255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:05.034064 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:05.040466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:05.040936 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:05.041360 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:05.042067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:05.042508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:05.042923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:05.055679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] HTTP exception thrown: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Request method failure captured: Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 HTTP/1.1 Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUHCyCEYol1yUOU-FkmvG7vXjEnQGgpaoOK8_c6S9BqCGBgY88B9iKx_kuiGeV3JgdXOclwGu-mNieGZNtxSf686l_HgYIEWnZ-OEX3tb4LomuVOY9iQCUQB5UUW7FynGy7HFB8GoKXRmxENCtrEknPV9E0kgFGSSZOsttpFfZHxeQ Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:24:05.057260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcd7d2bdaffb4d168f27cf6444e005dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 3326fcf3ccbc4a978e9e52e25456ad98 Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:05.059028 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '15c73035-4140-417b-b820-a1f7ce16e591'} Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:24:05.059887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:05.061230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:05.062508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Returning 404 to user: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:24:05.062508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e1663b2a-6c8e-4cc4-8965-77f0cfcee794 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 404 len: 111 microversion: 2.20 time: 0.029996 Aug 25 05:24:05.062508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 481/967] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:24:05 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:24:05.068620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-50592748-a32d-4e65-aac8-46b734cdfe3f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '.version_select at 0x7f2423c983a0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:05.153109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-50592748-a32d-4e65-aac8-46b734cdfe3f tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694814463" status: 204 len: 0 microversion: 2.20 time: 0.089133 Aug 25 05:24:05.153801 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 487/968] 10.222.0.16 () {60 vars in 1262 bytes} [Thu Aug 25 05:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694814463 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 05:24:05.731212 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:05.731824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:05.739290 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:05.739773 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:05.740206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:05.740905 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:05.741357 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:05.741812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:05.891151 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:05.900095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2473f8b4-2211-49fe-9c1d-0fec7aade855 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1319 microversion: 2.1 time: 0.172721 Aug 25 05:24:05.913563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 482/969] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:24:05 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:24:06.920767 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:06.921405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:06.927793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:06.928263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:06.928688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:06.929363 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:06.929839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:06.930256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:07.061797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:24:07.070258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-37c41df4-4217-4261-a4cb-2f0a223cdcb8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1508 microversion: 2.1 time: 0.153951 Aug 25 05:24:07.070825 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 488/970] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:24:06 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:24:07.499419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:07.499419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:07.504131 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:07.504608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:07.505034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:07.505736 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:07.506183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:07.506594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:07.520568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] HTTP exception thrown: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Request method failure captured: Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: DELETE /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 HTTP/1.1 Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUHCyCEYol1yUOU-FkmvG7vXjEnQGgpaoOK8_c6S9BqCGBgY88B9iKx_kuiGeV3JgdXOclwGu-mNieGZNtxSf686l_HgYIEWnZ-OEX3tb4LomuVOY9iQCUQB5UUW7FynGy7HFB8GoKXRmxENCtrEknPV9E0kgFGSSZOsttpFfZHxeQ Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:24:07.522339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcd7d2bdaffb4d168f27cf6444e005dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 3326fcf3ccbc4a978e9e52e25456ad98 Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.523906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '15c73035-4140-417b-b820-a1f7ce16e591'} Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:24:07.524730 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.526140 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.527527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Returning 404 to user: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:24:07.527527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d83b57cf-bfb9-4d85-b41e-5aed2f36a081 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 404 len: 111 microversion: 2.20 time: 0.031431 Aug 25 05:24:07.527527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 483/971] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Aug 25 05:24:07 2022] DELETE /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:24:07.532464 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:07.533075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 15c73035-4140-417b-b820-a1f7ce16e591] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:07.539637 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:07.540112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:07.540577 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:07.541256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:07.541727 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:07.542148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:07.555180 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] HTTP exception thrown: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Request method failure captured: Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 HTTP/1.1 Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUHCyCEYol1yUOU-FkmvG7vXjEnQGgpaoOK8_c6S9BqCGBgY88B9iKx_kuiGeV3JgdXOclwGu-mNieGZNtxSf686l_HgYIEWnZ-OEX3tb4LomuVOY9iQCUQB5UUW7FynGy7HFB8GoKXRmxENCtrEknPV9E0kgFGSSZOsttpFfZHxeQ Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:24:07.556813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcd7d2bdaffb4d168f27cf6444e005dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 3326fcf3ccbc4a978e9e52e25456ad98 Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.558416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '15c73035-4140-417b-b820-a1f7ce16e591'} Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:24:07.559230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. Aug 25 05:24:07.560706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:07.562045 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Returning 404 to user: Instance 15c73035-4140-417b-b820-a1f7ce16e591 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:24:07.562045 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5d8bdf35-a847-4c12-81c8-9768f6a781a3 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591" status: 404 len: 111 microversion: 2.20 time: 0.029721 Aug 25 05:24:07.562045 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 489/972] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:24:07 2022] GET /compute/v2.1/servers/15c73035-4140-417b-b820-a1f7ce16e591 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 25 05:24:08.894535 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:08.899090 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:08.902153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:08.902681 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:08.903150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:08.903886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:08.904404 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:08.904838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:08.920867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] HTTP exception thrown: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Request method failure captured: Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: DELETE /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 HTTP/1.1 Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwUHCyCEYol1yUOU-FkmvG7vXjEnQGgpaoOK8_c6S9BqCGBgY88B9iKx_kuiGeV3JgdXOclwGu-mNieGZNtxSf686l_HgYIEWnZ-OEX3tb4LomuVOY9iQCUQB5UUW7FynGy7HFB8GoKXRmxENCtrEknPV9E0kgFGSSZOsttpFfZHxeQ Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:24:08.922510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcd7d2bdaffb4d168f27cf6444e005dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 3326fcf3ccbc4a978e9e52e25456ad98 Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.925040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '070a4cc0-c2a7-4e19-b265-7c540dc6f045'} Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:24:08.933923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.935110 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.936295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Returning 404 to user: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:24:08.936295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9e48935f-079f-4dba-a2a7-e9be4121499c tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "DELETE /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 404 len: 111 microversion: 2.20 time: 0.033323 Aug 25 05:24:08.936295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 484/973] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Aug 25 05:24:08 2022] DELETE /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:24:08.936502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:24:08.936502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] [instance: 070a4cc0-c2a7-4e19-b265-7c540dc6f045] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:08.940587 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:08.941068 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:08.941495 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:08.942205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:08.942766 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:08.943213 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:08.957152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] HTTP exception thrown: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Request method failure captured: Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 HTTP/1.1 Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwUHCyCEYol1yUOU-FkmvG7vXjEnQGgpaoOK8_c6S9BqCGBgY88B9iKx_kuiGeV3JgdXOclwGu-mNieGZNtxSf686l_HgYIEWnZ-OEX3tb4LomuVOY9iQCUQB5UUW7FynGy7HFB8GoKXRmxENCtrEknPV9E0kgFGSSZOsttpFfZHxeQ Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:24:08.958782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dcd7d2bdaffb4d168f27cf6444e005dd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dcd7d2bdaffb4d168f27cf6444e005dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: dcd7d2bdaffb4d168f27cf6444e005dd Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1637847868 Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 3326fcf3ccbc4a978e9e52e25456ad98 Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1637847868-project Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.960461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '070a4cc0-c2a7-4e19-b265-7c540dc6f045'} Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:24:08.961999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. Aug 25 05:24:08.963409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:24:08.964928 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] Returning 404 to user: Instance 070a4cc0-c2a7-4e19-b265-7c540dc6f045 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:24:08.964928 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bf04c268-ab68-4c96-b70e-ed1ecaa77406 tempest-AttachVolumeShelveTestJSON-1637847868 tempest-AttachVolumeShelveTestJSON-1637847868-project] 10.222.0.16 "GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045" status: 404 len: 111 microversion: 2.20 time: 0.030696 Aug 25 05:24:08.964928 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 490/974] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Aug 25 05:24:08 2022] GET /compute/v2.1/servers/070a4cc0-c2a7-4e19-b265-7c540dc6f045 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 05:24:33.407308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ab04175-4a2a-4802-ab8e-0569d40e54a5", "device": "/dev/sdb"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:24:33.411278 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:24:33.413509 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:33.414178 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=12 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:24:33.418791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:33.419262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:33.419688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:33.420367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:24:33.420809 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:24:33.421235 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:24:34.390549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7ac2b459-42f3-45b8-ba2a-e2b8db081c6c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "POST /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987712 Aug 25 05:24:34.397893 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 485/975] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:24:33 2022] POST /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:25:04.839031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:04.840138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:04.842434 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:04.843109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=34 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:04.847807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:04.848555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:04.851888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:04.851888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:04.851888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:04.851888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:04.935565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lazy-loading 'services' on Instance uuid a08b426c-39ad-464b-8924-a915541a804a {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:25:05.127463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-52c5c9af-3729-4e41-b2ee-ede272c71864 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a/os-volume_attachments/1ab04175-4a2a-4802-ab8e-0569d40e54a5" status: 202 len: 0 microversion: 2.1 time: 0.292436 Aug 25 05:25:05.128110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 491/976] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:25:04 2022] DELETE /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a/os-volume_attachments/1ab04175-4a2a-4802-ab8e-0569d40e54a5 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 05:25:06.253434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:06.254504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:06.258828 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:06.259624 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:06.266122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:06.266583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:06.267182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:06.268052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:06.268493 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:06.269185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:06.295605 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:25:06.706088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8e5e6084-5004-48ed-a363-316d5d89f352 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 204 len: 0 microversion: 2.1 time: 0.453760 Aug 25 05:25:06.706979 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 486/977] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:25:06 2022] DELETE /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:25:06.717741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:06.718450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:06.725300 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:06.725805 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:06.726228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:06.729205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:06.730634 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:06.731514 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:06.882008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:06.889887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8e843200-aadc-4d68-a163-297df05b5462 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1514 microversion: 2.1 time: 0.178100 Aug 25 05:25:06.890455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 492/978] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:06 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:07.912326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:07.913023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:07.920790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:07.921267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:07.921719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:07.922399 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:07.922839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:07.923246 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:08.071551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:08.079418 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d3137ae4-835f-4aef-8e95-0e1e594c3b7c tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1514 microversion: 2.1 time: 0.171282 Aug 25 05:25:08.079996 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 487/979] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:07 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:09.100863 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:09.101769 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:09.108596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:09.109063 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:09.109461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:09.110181 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:09.110635 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:09.111049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:09.257899 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:09.266013 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d5d2904f-d0ee-4487-8f95-26747956b87f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1514 microversion: 2.1 time: 0.169385 Aug 25 05:25:09.266599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 493/980] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:09 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:09.846609 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-ab61fbe6-566f-4151-b3a6-a84b99d713cc req-937e3eb5-0d71-4bdb-9a1f-7b71e43de0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08b426c-39ad-464b-8924-a915541a804a", "name": "network-vif-deleted", "tag": "3da211dd-640d-4862-9c7a-cd29f2a0c659"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:25:09.856880 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ab61fbe6-566f-4151-b3a6-a84b99d713cc req-937e3eb5-0d71-4bdb-9a1f-7b71e43de0e3 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:09.857344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ab61fbe6-566f-4151-b3a6-a84b99d713cc req-937e3eb5-0d71-4bdb-9a1f-7b71e43de0e3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:09.857800 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ab61fbe6-566f-4151-b3a6-a84b99d713cc req-937e3eb5-0d71-4bdb-9a1f-7b71e43de0e3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:09.868835 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-ab61fbe6-566f-4151-b3a6-a84b99d713cc req-937e3eb5-0d71-4bdb-9a1f-7b71e43de0e3 service nova] Creating event network-vif-deleted:3da211dd-640d-4862-9c7a-cd29f2a0c659 for instance a08b426c-39ad-464b-8924-a915541a804a on hv-cinder-85391 Aug 25 05:25:09.873908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-ab61fbe6-566f-4151-b3a6-a84b99d713cc req-937e3eb5-0d71-4bdb-9a1f-7b71e43de0e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162939 Aug 25 05:25:09.874669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 488/981] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:25:10.286736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:10.287336 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:10.293718 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:10.294193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:10.294618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:10.295296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:10.295786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:10.296203 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:10.327202 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:10.327668 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:10.328094 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:10.328530 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lazy-loading 'fault' on Instance uuid a08b426c-39ad-464b-8924-a915541a804a {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:25:10.377988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:10.386374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7f56d2a5-c989-4d1c-8abe-2036bef7b2d8 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 200 len: 1309 microversion: 2.1 time: 0.103019 Aug 25 05:25:10.386958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 494/982] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:10 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:11.408073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:11.408772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: a08b426c-39ad-464b-8924-a915541a804a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:11.415015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:11.415490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:11.415919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:11.416600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:11.417052 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:11.417463 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:11.430603 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] HTTP exception thrown: Instance a08b426c-39ad-464b-8924-a915541a804a could not be found. Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Request method failure captured: Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a HTTP/1.1 Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwdkY3X_HdS9ewwE-vULehHeRChMX7skvqDYp7Fp92orf64gD59Ta1AwyGOa-0ddTKzpGmTkQ7NWgDShFzsaiVNNXfglDNrn8GEFXXsaTCs67Od8VEflNUiEG1bNV0g9BwAEV-ghZknEMmVLkjFd-nFCD8BS1Nv4Q2aqcDvWAFEXjBs Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: aed82d3b5299415ca1e2e3cfcb7e2d0b Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1857286973 Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:25:11.432214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aed82d3b5299415ca1e2e3cfcb7e2d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aed82d3b5299415ca1e2e3cfcb7e2d0b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aed82d3b5299415ca1e2e3cfcb7e2d0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aed82d3b5299415ca1e2e3cfcb7e2d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesSnapshotTestJSON-1857286973 Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: aed82d3b5299415ca1e2e3cfcb7e2d0b Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1857286973 Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesSnapshotTestJSON-1857286973-project Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 6a4136b08cc1464eac6c779652a1d2b1 Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesSnapshotTestJSON-1857286973-project Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance a08b426c-39ad-464b-8924-a915541a804a could not be found. Aug 25 05:25:11.438723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': 'a08b426c-39ad-464b-8924-a915541a804a'} Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08b426c-39ad-464b-8924-a915541a804a could not be found. Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:25:11.439642 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08b426c-39ad-464b-8924-a915541a804a could not be found. Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08b426c-39ad-464b-8924-a915541a804a could not be found. Aug 25 05:25:11.441215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:25:11.442623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Returning 404 to user: Instance a08b426c-39ad-464b-8924-a915541a804a could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:25:11.442623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0d700507-f3cf-4b81-897f-f5f908ca0790 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a" status: 404 len: 111 microversion: 2.1 time: 0.030185 Aug 25 05:25:11.442623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 489/983] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:11 2022] GET /compute/v2.1/servers/a08b426c-39ad-464b-8924-a915541a804a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:25:26.159861 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1448170164", "imageRef": "eecf8808-3b0a-48ea-be40-eada05b01f27", "flavorRef": "452", "networks": [{"uuid": "e49da47a-f1e4-484e-87dc-9a576ec5b8c0"}]}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:25:26.167957 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=10 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:26.174049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:26.213799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] validate_networks() for [('e49da47a-f1e4-484e-87dc-9a576ec5b8c0', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:25:26.671396 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:25:26.675676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:25:26.675676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:25:26.675676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:25:26.675676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:25:26.682104 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:26.682585 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:26.683041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:26.683768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:26.684220 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:26.684662 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:26.703286 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Getting quotas for project aed82d3b5299415ca1e2e3cfcb7e2d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:25:26.707433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Getting quotas for user 6a4136b08cc1464eac6c779652a1d2b1 and project aed82d3b5299415ca1e2e3cfcb7e2d0b. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:25:26.720182 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:25:26.722532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eecf8808-3b0a-48ea-be40-eada05b01f27',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:25:26.868401 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9cccaad2-85fa-4f18-a3f1-4245f2c413c4 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712503 Aug 25 05:25:26.869625 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 495/984] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:25:26.880524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-465ab2aa-abac-4e73-93ff-fb955c68d5dc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:26.881777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-465ab2aa-abac-4e73-93ff-fb955c68d5dc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:26.887919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:26.888577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:26.889314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:25:26.889464 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Thu Aug 25 05:25:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d (ip 10.222.0.16) !!! Aug 25 05:25:26.953792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-465ab2aa-abac-4e73-93ff-fb955c68d5dc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:26.963470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-465ab2aa-abac-4e73-93ff-fb955c68d5dc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1219 microversion: 2.1 time: 0.086759 Aug 25 05:25:26.965679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 490/985] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:26 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:27.986673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:27.987461 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:27.994579 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:27.995083 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:27.995518 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:27.996216 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:27.996696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:27.997122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:28.064948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:28.073793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-73016687-9fe0-42db-ba32-03c717887c57 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1223 microversion: 2.1 time: 0.092142 Aug 25 05:25:28.082983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 496/986] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:27 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:29.094716 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:29.095260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:29.102842 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:29.103448 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:29.104037 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:29.104880 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:29.105339 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:29.106088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:29.171595 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:29.179178 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-011ecdcb-34cf-4e0b-9d85-f6c702102d78 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1271 microversion: 2.1 time: 0.088845 Aug 25 05:25:29.179741 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 491/987] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:29 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:30.200789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:30.201383 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:30.208886 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:30.209369 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:30.209902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:30.210712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:30.211166 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:30.211647 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:30.348798 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:30.356472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8a8e1174-2807-4349-ab02-52a62977039a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.159702 Aug 25 05:25:30.357036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 497/988] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:30 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:31.020462 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-4c4c4a4d-3155-4202-a27b-7cccdab3d119 req-61c226a1-81c3-45ed-8043-d40191f533e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d", "tag": "bf09cc45-a8bb-4724-b53a-bd77ad1a9d3b"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:25:31.032162 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4c4c4a4d-3155-4202-a27b-7cccdab3d119 req-61c226a1-81c3-45ed-8043-d40191f533e0 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:31.032626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4c4c4a4d-3155-4202-a27b-7cccdab3d119 req-61c226a1-81c3-45ed-8043-d40191f533e0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:31.033046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4c4c4a4d-3155-4202-a27b-7cccdab3d119 req-61c226a1-81c3-45ed-8043-d40191f533e0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:31.044784 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-4c4c4a4d-3155-4202-a27b-7cccdab3d119 req-61c226a1-81c3-45ed-8043-d40191f533e0 service nova] Creating event network-changed:bf09cc45-a8bb-4724-b53a-bd77ad1a9d3b for instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d on hv-cinder-85391 Aug 25 05:25:31.053451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-4c4c4a4d-3155-4202-a27b-7cccdab3d119 req-61c226a1-81c3-45ed-8043-d40191f533e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034844 Aug 25 05:25:31.053451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 492/989] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:25:31.377676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:31.378242 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:31.385982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:31.386457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:31.386885 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:31.387573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:31.388078 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:31.388688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:31.528511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:31.538740 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a7fe995f-bdd6-406d-89b6-64d734aa229a tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.165434 Aug 25 05:25:31.539705 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 498/990] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:31 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:32.560353 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:32.561074 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:32.567651 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:32.568122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:32.568568 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:32.569225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:32.569708 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:32.571458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:32.699219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:32.707931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-26aec197-a176-4989-9ef0-5ac4ecb79753 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.152237 Aug 25 05:25:32.708504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 493/991] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:32 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:33.728947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:33.729573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:33.737476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:33.737933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:33.738366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:33.739076 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:33.739631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:33.740324 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:33.875544 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:33.883534 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-30ebc082-c7cd-4172-8e8b-f3caa1711ff0 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.158673 Aug 25 05:25:33.884174 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 499/992] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:33 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:34.904124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:34.904729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:34.911207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:34.911683 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:34.912112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:34.912793 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:34.913238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:34.913698 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:35.042143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:35.050199 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fca1f9ab-5630-432a-b853-99aad23f4fa3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.150052 Aug 25 05:25:35.050764 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 494/993] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:34 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:36.071981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:36.072667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:36.079035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:36.080864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:36.080864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:36.080864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:36.081167 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:36.081522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:36.211402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:36.219131 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6d0b31f6-8c75-4774-a9fa-a202a87cccf7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.151273 Aug 25 05:25:36.219698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 500/994] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:36 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:37.240311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:37.240919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:37.243382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:37.248156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:37.248614 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:37.249044 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:37.249760 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:37.250214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:37.250635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:37.392034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:37.400504 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cf8d4685-0197-4997-bd4d-ddc593084ed6 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.164136 Aug 25 05:25:37.401064 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 495/995] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:37 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:38.421389 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:38.422011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:38.425141 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:38.426165 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=6 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:25:38.431984 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:38.436512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:38.436512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:38.436512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:38.436512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:38.436883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:38.564228 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:38.571908 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c97c8b6d-2113-4b00-ae93-b8680775e668 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.154301 Aug 25 05:25:38.572457 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 501/996] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:38 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:38.788209 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-69546d93-a53b-4389-be4e-fca584d17c30 req-60872259-1926-485f-8982-eda2f4f16e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d", "name": "network-vif-plugged", "status": "completed", "tag": "bf09cc45-a8bb-4724-b53a-bd77ad1a9d3b"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:25:38.797707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-69546d93-a53b-4389-be4e-fca584d17c30 req-60872259-1926-485f-8982-eda2f4f16e1e service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:38.798174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-69546d93-a53b-4389-be4e-fca584d17c30 req-60872259-1926-485f-8982-eda2f4f16e1e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:38.798591 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-69546d93-a53b-4389-be4e-fca584d17c30 req-60872259-1926-485f-8982-eda2f4f16e1e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:38.809348 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-69546d93-a53b-4389-be4e-fca584d17c30 req-60872259-1926-485f-8982-eda2f4f16e1e service nova] Creating event network-vif-plugged:bf09cc45-a8bb-4724-b53a-bd77ad1a9d3b for instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d on hv-cinder-85391 Aug 25 05:25:38.814216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-69546d93-a53b-4389-be4e-fca584d17c30 req-60872259-1926-485f-8982-eda2f4f16e1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146551 Aug 25 05:25:38.814776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 496/997] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:25:39.592222 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:39.592760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:39.599446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:39.599921 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:39.600352 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:39.601034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:39.601484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:39.601933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:39.728871 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:39.736512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b1c064bc-cabf-41e0-bc7c-c0b6010ee6b3 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.148199 Aug 25 05:25:39.737075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 502/998] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:39 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:40.759027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:40.759756 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:40.765915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:40.766389 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:40.766819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:40.767501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:40.767949 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:40.768368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:40.895098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:40.902704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c01397ee-555d-4be3-8652-51cb0e381740 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.148992 Aug 25 05:25:40.903272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 497/999] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:40 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:41.923206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:41.923813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:41.930780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:41.931257 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:41.931687 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:41.932384 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:41.932816 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:41.933263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:42.062035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:42.070099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6d19fb39-cae3-4f08-84cf-221ee5aba313 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.150833 Aug 25 05:25:42.070656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 503/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:41 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:43.092617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:43.119466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:43.119466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:43.119466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:43.119466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:43.119869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:43.119869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:43.119869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:43.233572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:43.241786 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d69990ff-f9c4-47db-a526-c471a3497abc tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.154883 Aug 25 05:25:43.242346 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 498/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:43 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:44.262494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:44.263042 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:44.270087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:44.270559 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:44.270986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:44.271668 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:44.272116 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:44.272534 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:44.397998 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:44.405554 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7c762562-a240-44b5-88c7-8a8e76289c2d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.146977 Aug 25 05:25:44.406137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 504/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:44 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:45.424844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:45.426223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:45.433763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:45.439717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:45.439717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:45.439717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:45.439717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:45.440323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:45.570789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:45.578577 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cf33a640-35ec-4c36-965d-fb27512d5515 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.157544 Aug 25 05:25:45.579363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 499/1003] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:45 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:46.599373 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:46.599983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:46.606402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:46.606882 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:46.607312 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:46.608001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:46.608452 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:46.608880 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:46.743149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:46.750824 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7765562e-831c-4bcd-b2d5-de60e2770b90 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.155679 Aug 25 05:25:46.751389 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 505/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:46 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:47.771940 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:47.772545 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:47.779021 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:47.779502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:47.779939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:47.780626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:47.781079 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:47.781501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:47.910772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:47.918442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-356363d4-f5aa-4d24-93cf-d42ed80fb899 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.150779 Aug 25 05:25:47.918999 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 500/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:47 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:48.938025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:48.938636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:48.945177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:48.945687 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:48.946124 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:48.946842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:48.947291 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:48.947714 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:49.075357 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:49.083491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-090e7ddf-0ebc-4e41-96d9-804b10946e2b tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.149353 Aug 25 05:25:49.084060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 506/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:48 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:25:50.104772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:50.105375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:50.111740 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:50.112218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:50.113134 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:50.113836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:50.114277 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:50.114690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:50.241076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:50.248583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-66554940-d6c9-42fc-a14b-800cc33a45c9 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1319 microversion: 2.1 time: 0.147745 Aug 25 05:25:50.249145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 501/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:50 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:51.269728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:25:51.270334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:51.276734 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:51.277210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:51.277684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:51.278502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:51.278950 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:51.279364 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:51.412820 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:25:51.420715 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a02be44b-807d-48f0-bf79-76a57f5863e7 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1509 microversion: 2.1 time: 0.155549 Aug 25 05:25:51.421276 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 507/1008] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:25:51 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:25:51.443549 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "781ea4dd-6d2b-4207-8a36-1715e74dae3c", "device": "/dev/sdb"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:25:51.446967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:25:51.453494 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:51.455586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:51.455586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:51.455586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:25:51.455586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:25:51.456198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:25:52.269077 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-29b290ee-83c7-4412-b063-3a1417bc9e4d tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "POST /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830758 Aug 25 05:25:52.269732 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 502/1009] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:25:51 2022] POST /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:26:25.018334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:25.018839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:25.021141 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:25.021824 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=74 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:25.027089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:25.027573 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:25.028015 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:25.028715 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:25.029169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:25.029610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:25.111131 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lazy-loading 'services' on Instance uuid 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:26:25.383316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-46ba62ac-123b-479c-95aa-b7ebe2247195 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d/os-volume_attachments/781ea4dd-6d2b-4207-8a36-1715e74dae3c" status: 202 len: 0 microversion: 2.1 time: 0.368813 Aug 25 05:26:25.384062 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 508/1010] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:26:25 2022] DELETE /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d/os-volume_attachments/781ea4dd-6d2b-4207-8a36-1715e74dae3c => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:26:27.591025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=28 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:27.593268 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:27.597327 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:27.597944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:27.605368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:27.605869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:27.606478 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:27.607167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:27.607611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:27.608606 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:27.634609 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:26:27.887126 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-57cd1708-4624-47b9-9275-83e80d660b41 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 204 len: 0 microversion: 2.1 time: 0.298058 Aug 25 05:26:27.887837 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 503/1011] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:26:27 2022] DELETE /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:26:27.899027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:27.900345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:27.906882 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:27.907361 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:27.907997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:27.908886 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:27.909337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:27.909809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:28.048721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:28.057887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-dfbcc48d-a1b0-4eda-8696-7fda20667da5 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1515 microversion: 2.1 time: 0.164935 Aug 25 05:26:28.058488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 509/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:27 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:29.086388 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:29.087192 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:29.094271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:29.094756 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:29.095181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:29.095878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:29.096317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:29.096731 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:29.356414 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:29.368907 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c22a9b14-e366-4aab-8171-b410da2735ae tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1515 microversion: 2.1 time: 0.291656 Aug 25 05:26:29.369749 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 504/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:29 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:30.393329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:30.394351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:30.401520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:30.402294 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:30.408316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:30.408316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:30.408316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:30.408316 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:30.584043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:30.596373 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-971061a0-c849-4f72-a907-c3222e07c8bd tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1515 microversion: 2.1 time: 0.209113 Aug 25 05:26:30.596961 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 510/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:30 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:31.145699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-488a7d2f-d26d-4211-87b7-f7eb348f724e req-28c2173a-0aed-4a8f-a128-19f0bc5198cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d", "name": "network-vif-deleted", "tag": "bf09cc45-a8bb-4724-b53a-bd77ad1a9d3b"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:26:31.161085 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-488a7d2f-d26d-4211-87b7-f7eb348f724e req-28c2173a-0aed-4a8f-a128-19f0bc5198cf service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:31.161760 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-488a7d2f-d26d-4211-87b7-f7eb348f724e req-28c2173a-0aed-4a8f-a128-19f0bc5198cf service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:31.162194 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-488a7d2f-d26d-4211-87b7-f7eb348f724e req-28c2173a-0aed-4a8f-a128-19f0bc5198cf service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:31.175181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-488a7d2f-d26d-4211-87b7-f7eb348f724e req-28c2173a-0aed-4a8f-a128-19f0bc5198cf service nova] Creating event network-vif-deleted:bf09cc45-a8bb-4724-b53a-bd77ad1a9d3b for instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d on hv-cinder-85391 Aug 25 05:26:31.182198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-488a7d2f-d26d-4211-87b7-f7eb348f724e req-28c2173a-0aed-4a8f-a128-19f0bc5198cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041602 Aug 25 05:26:31.182867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 505/1015] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:26:31.622135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:31.622750 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:31.630184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:31.630673 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:31.631175 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:31.632394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:31.632996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:31.633409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:31.674939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:31.675451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:31.675901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:31.676370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lazy-loading 'fault' on Instance uuid 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:26:31.725405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a4136b08cc1464eac6c779652a1d2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aed82d3b5299415ca1e2e3cfcb7e2d0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:31.735192 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ec704ab7-4ac2-4834-90ae-cf1d815de97f tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 200 len: 1309 microversion: 2.1 time: 0.121290 Aug 25 05:26:31.736101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 511/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:31 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 1309 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:32.758220 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:32.759038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] [instance: 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:32.765548 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:32.766138 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:32.766573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:32.767318 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:32.767774 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:32.768201 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:32.782904 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] HTTP exception thrown: Instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d could not be found. Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Request method failure captured: Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d HTTP/1.1 Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwdkY3X_HdS9ewwE-vULehHeRChMX7skvqDYp7Fp92orf64gD59Ta1AwyGOa-0ddTKzpGmTkQ7NWgDShFzsaiVNNXfglDNrn8GEFXXsaTCs67Od8VEflNUiEG1bNV0g9BwAEV-ghZknEMmVLkjFd-nFCD8BS1Nv4Q2aqcDvWAFEXjBs Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: aed82d3b5299415ca1e2e3cfcb7e2d0b Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1857286973 Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:26:32.784546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aed82d3b5299415ca1e2e3cfcb7e2d0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aed82d3b5299415ca1e2e3cfcb7e2d0b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aed82d3b5299415ca1e2e3cfcb7e2d0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aed82d3b5299415ca1e2e3cfcb7e2d0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-VolumesSnapshotTestJSON-1857286973 Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: aed82d3b5299415ca1e2e3cfcb7e2d0b Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1857286973 Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-VolumesSnapshotTestJSON-1857286973-project Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 6a4136b08cc1464eac6c779652a1d2b1 Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-VolumesSnapshotTestJSON-1857286973-project Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d could not be found. Aug 25 05:26:32.786302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d'} Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d could not be found. Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:26:32.787365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d could not be found. Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d could not be found. Aug 25 05:26:32.789523 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:26:32.790758 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] Returning 404 to user: Instance 9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:26:32.790758 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-557baf4d-b254-4964-8d85-edb8c904cae1 tempest-VolumesSnapshotTestJSON-1857286973 tempest-VolumesSnapshotTestJSON-1857286973-project] 10.222.0.16 "GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d" status: 404 len: 111 microversion: 2.1 time: 0.033290 Aug 25 05:26:32.790758 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 506/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:32 2022] GET /compute/v2.1/servers/9ae34ab1-569c-48ac-b5ad-1b7b8a5a559d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:26:50.705272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1075ac3a-e9a8-4f85-a11f-9a957f429c52 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Action: 'create', calling method: .version_select at 0x7f2423bb80d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-199753860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7PbfDJIQqmOEQSDiX28yEAHmQ5xVFj05/0fVmsZVlJHpx+pnWcZnF2R8EA3x9W/Dv2Dx7CGrhMdG5rXtNUALcs1XCCyOJr7ipTyIaqqGFSYgLg/PRpFon9ofJtmpRvjg=="}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:26:50.711363 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=10 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:50.712034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:50.722887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-1075ac3a-e9a8-4f85-a11f-9a957f429c52 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Getting quotas for project b0f35b076ec94efda11070e02d3a5acd. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:26:50.727150 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-1075ac3a-e9a8-4f85-a11f-9a957f429c52 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Getting quotas for user fb70879694d443df9b30ff172cfa39b4 and project b0f35b076ec94efda11070e02d3a5acd. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:26:50.818985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1075ac3a-e9a8-4f85-a11f-9a957f429c52 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.117597 Aug 25 05:26:50.819536 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 512/1018] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:26:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:26:50.868992 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1106454995", "imageRef": "f0eca546-7084-4175-afab-0c374eb59dbc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-199753860", "networks": [{"uuid": "ff65d649-32c8-4f76-ba1c-3f3a70eb2fbb"}]}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:26:50.877216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:50.877896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:26:50.921155 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] validate_networks() for [('ff65d649-32c8-4f76-ba1c-3f3a70eb2fbb', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:26:51.381614 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:26:51.382030 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:26:51.382490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:26:51.382885 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:26:51.383310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:26:51.391896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:51.392364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:51.392782 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:51.393490 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:51.393963 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:51.394375 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:51.411537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Getting quotas for project b0f35b076ec94efda11070e02d3a5acd. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:26:51.416163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Getting quotas for user fb70879694d443df9b30ff172cfa39b4 and project b0f35b076ec94efda11070e02d3a5acd. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:26:51.427067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:26:51.429305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f0eca546-7084-4175-afab-0c374eb59dbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:26:51.572985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6ddefc80-81b4-4cf7-8765-e64dbc72640f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708619 Aug 25 05:26:51.573843 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 507/1019] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:26:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:26:51.585155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2a314ebb-64c1-42c1-8ee8-a475638b1234 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:51.585813 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2a314ebb-64c1-42c1-8ee8-a475638b1234 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:51.645815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2a314ebb-64c1-42c1-8ee8-a475638b1234 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:51.655452 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2a314ebb-64c1-42c1-8ee8-a475638b1234 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1258 microversion: 2.1 time: 0.075122 Aug 25 05:26:51.656022 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 513/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:51 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:52.678193 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1eace7e0-ce4d-44ee-938c-540448f6c136 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:52.678791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1eace7e0-ce4d-44ee-938c-540448f6c136 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:52.731429 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1eace7e0-ce4d-44ee-938c-540448f6c136 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:52.738115 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1eace7e0-ce4d-44ee-938c-540448f6c136 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1258 microversion: 2.1 time: 0.065739 Aug 25 05:26:52.738669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 508/1021] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:52 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:53.758403 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cc7bcf24-111e-43fb-a7f3-58d499441acf tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:53.759004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cc7bcf24-111e-43fb-a7f3-58d499441acf tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:53.811888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cc7bcf24-111e-43fb-a7f3-58d499441acf tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:53.819318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cc7bcf24-111e-43fb-a7f3-58d499441acf tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1258 microversion: 2.1 time: 0.064817 Aug 25 05:26:53.819873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 514/1022] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:53 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:54.840227 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-edd8d306-d2e4-4be9-8603-18263dfa247f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:54.840830 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-edd8d306-d2e4-4be9-8603-18263dfa247f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:54.892380 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-edd8d306-d2e4-4be9-8603-18263dfa247f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:54.899891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-edd8d306-d2e4-4be9-8603-18263dfa247f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1258 microversion: 2.1 time: 0.063537 Aug 25 05:26:54.900695 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 509/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:54 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:55.920640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:55.921254 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:55.928723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:55.929202 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:55.929698 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:55.930381 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:55.930861 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:55.931283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:55.991658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:55.999368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5ef4f650-4531-4900-9a6d-9b4e853e3497 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1262 microversion: 2.1 time: 0.082669 Aug 25 05:26:55.999913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 515/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:55 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:57.020849 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:57.021464 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:57.028747 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:57.029365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:57.029826 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:57.030522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:57.030970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:57.031566 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:57.094676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:57.104626 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-260e86cc-9f15-4af5-aa48-cfb2155cfe79 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1262 microversion: 2.1 time: 0.088196 Aug 25 05:26:57.105242 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 510/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:57 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1262 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:26:58.126214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:58.126890 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:58.134001 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:58.134539 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:58.134968 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:58.135654 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:58.136120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:58.136553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:58.197196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:58.204959 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8c5d0531-893e-482f-815f-320bba8ad473 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1310 microversion: 2.1 time: 0.082726 Aug 25 05:26:58.205528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 516/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:58 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:26:59.227759 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:26:59.228368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:26:59.234848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:59.235324 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:59.235748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:59.236427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:26:59.236869 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:26:59.237292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:26:59.367351 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:26:59.375014 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9ee0fb61-9a4e-497b-a6a6-6d21bdf447e5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.151860 Aug 25 05:26:59.375579 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 511/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:26:59 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:00.396298 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:00.396904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:00.403323 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:00.403844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:00.404274 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:00.404960 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:00.405409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:00.405856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:00.535570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:00.543779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-573f8f9a-ded3-4406-9779-d882ef398a75 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.151473 Aug 25 05:27:00.544341 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 517/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:00 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:01.564116 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:01.564728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:01.567058 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:01.571759 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:01.572246 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:01.572679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:01.573373 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:01.573878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:01.574283 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:01.702020 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:01.710114 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8bd3b21d-e602-4177-8845-b710814de01e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.149829 Aug 25 05:27:01.710667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 512/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:01 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:02.731169 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:02.731714 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:02.738029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:02.738511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:02.738934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:02.739621 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:02.740065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:02.740538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:02.869440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:02.878545 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cfc0311e-0d4a-4bf8-9fab-f8f3772246a7 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.151196 Aug 25 05:27:02.887258 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 518/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:02 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:03.875260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-89184f55-87de-46d0-b524-30b716df2175 req-7a490fbe-5bfe-4186-8f8e-5f857d9d7f9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49659f3e-6163-4c23-80d7-2be2b2c4119a", "tag": "900a73f5-8be4-4458-b1a2-c46381499c03"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:27:03.889972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-89184f55-87de-46d0-b524-30b716df2175 req-7a490fbe-5bfe-4186-8f8e-5f857d9d7f9f service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:03.894210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-89184f55-87de-46d0-b524-30b716df2175 req-7a490fbe-5bfe-4186-8f8e-5f857d9d7f9f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:03.894745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-89184f55-87de-46d0-b524-30b716df2175 req-7a490fbe-5bfe-4186-8f8e-5f857d9d7f9f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:03.908641 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:03.909252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-89184f55-87de-46d0-b524-30b716df2175 req-7a490fbe-5bfe-4186-8f8e-5f857d9d7f9f service nova] Creating event network-changed:900a73f5-8be4-4458-b1a2-c46381499c03 for instance 49659f3e-6163-4c23-80d7-2be2b2c4119a on hv-cinder-85391 Aug 25 05:27:03.910480 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:03.914867 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-89184f55-87de-46d0-b524-30b716df2175 req-7a490fbe-5bfe-4186-8f8e-5f857d9d7f9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043184 Aug 25 05:27:03.916023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 513/1031] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:27:03.919542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=8 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:03.923566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:03.926049 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:03.926729 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:03.928246 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:03.929028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:03.929719 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:04.103621 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:04.114674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bc031f71-c6f9-42b0-abc1-06272470b1a8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.211885 Aug 25 05:27:04.116092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 519/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:03 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:05.134186 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=10 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:05.138296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:05.139000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:05.145697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:05.147096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:05.147776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:05.148725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:05.149432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:05.150096 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:05.296396 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:05.305634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8ccfabc5-4e37-4484-a3a2-be167f7db7dc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.172710 Aug 25 05:27:05.306607 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 514/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:05 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:06.327565 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:06.328222 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:06.334874 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:06.335358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:06.335824 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:06.336525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:06.336978 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:06.337403 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:06.480244 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:06.488236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-df6d0b01-53f9-4ea5-9e8a-10f7b82be9fc tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.165296 Aug 25 05:27:06.488818 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 520/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:06 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:27:07.510275 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:07.511798 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:07.519150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:07.520156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:07.520827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:07.522416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:07.523084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:07.523718 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:07.673034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:07.685093 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e0c71fd2-0412-4b9b-a1ae-5853f8b65037 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.179351 Aug 25 05:27:07.685697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 515/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:07 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:27:08.706297 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:08.706991 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:08.713580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:08.714110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:08.714540 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:08.715239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:08.715684 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:08.716157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:08.855923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:08.864578 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-de1e7977-3fcd-4795-b01f-9608ef94b4c5 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.162587 Aug 25 05:27:08.865243 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 521/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:08 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:09.888403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:09.889150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:09.896363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:09.896990 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:09.897427 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:09.898223 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:09.898671 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:09.899088 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:10.041370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:10.049856 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-17656b90-3c92-4f08-aad2-66e240e9bcb3 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.166232 Aug 25 05:27:10.050696 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 516/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:09 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:11.072434 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:11.073041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:11.079440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:11.079918 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:11.080347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:11.081033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:11.081483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:11.081929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:11.213434 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:11.221439 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-55b1281f-45a4-49fc-9032-47ad17098834 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.153496 Aug 25 05:27:11.223607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 522/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:11 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:12.244968 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:12.245611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:12.252089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:12.252563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:12.252984 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:12.253737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:12.254200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:12.254613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:12.388004 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:12.395565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-57b7b36c-3b4f-4c58-ae33-6c0ee63624a6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.155582 Aug 25 05:27:12.396138 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 517/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:12 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:13.416108 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:13.416746 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:13.423171 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:13.426527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:13.426527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:13.426527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:13.426527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:13.426906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:13.552642 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:13.560470 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-828788f8-b6d3-462e-929a-8c5ae8a6ab45 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.148749 Aug 25 05:27:13.561030 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 523/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:13 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:14.587253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:14.587253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:14.592337 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:14.592815 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:14.593246 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:14.594087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:14.594527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:14.594942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:14.729635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:14.737494 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fa81e381-6cbc-4b81-8ec6-bf8010cd72b1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.157093 Aug 25 05:27:14.738127 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 518/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:14 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:15.758802 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:15.759406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:15.765843 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:15.766314 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:15.766744 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:15.767423 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:15.767867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:15.768293 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:15.903007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:15.911736 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-087ea039-f882-495b-bf14-967a406f524f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.156763 Aug 25 05:27:15.916941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 524/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:15 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:16.936049 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:16.936661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:16.943062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:16.943546 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:16.943975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:16.944660 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:16.945314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:16.945707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:17.072497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:17.080210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6cf00197-d50e-4977-9d41-f61a275331fe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.147948 Aug 25 05:27:17.080780 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 519/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:16 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:18.101717 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:18.102326 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:18.108546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:18.109018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:18.109443 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:18.110146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:18.110611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:18.111006 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:18.239970 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:18.248148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2955c9d9-550a-46f1-a072-ed520fee1e12 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.150671 Aug 25 05:27:18.248702 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 525/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:18 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:19.269296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:19.269934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:19.276838 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:19.277309 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:19.277772 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:19.278444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:19.278889 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:19.279302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:19.410991 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:19.418647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-99268f14-e631-4d02-b5cf-d3f290ca6df6 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.153165 Aug 25 05:27:19.419214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 520/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:19 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:20.438788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:20.439391 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:20.445797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:20.446267 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:20.446693 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:20.447367 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:20.447837 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:20.448251 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:20.572950 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:20.580596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7fd6275e-4b03-4b2a-a18d-66a00bb59719 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.145737 Aug 25 05:27:20.591091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 526/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:20 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:21.603649 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:21.604319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:21.607889 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:21.611342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:21.611821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:21.612253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:21.612967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:21.613742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:21.614163 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:21.619039 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=65 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:21.753741 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:21.761682 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-efdb17bb-0c13-4656-b3eb-d3accdfe4962 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.163575 Aug 25 05:27:21.762252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 521/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:21 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:22.782376 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:22.782988 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:22.786068 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:22.790986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:22.791466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:22.794892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:22.794892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:22.794892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:22.794892 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:22.797385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=73 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:22.935427 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:22.943417 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3f9291d6-99e4-4f59-9d7f-47249aadd275 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.164861 Aug 25 05:27:22.944020 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 527/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:22 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:23.064055 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-eb97d6d2-373b-45de-907b-53c9abbdf389 req-fb046e53-a5cb-42e1-b904-c8a75469bdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49659f3e-6163-4c23-80d7-2be2b2c4119a", "name": "network-vif-plugged", "status": "completed", "tag": "900a73f5-8be4-4458-b1a2-c46381499c03"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:27:23.074132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-eb97d6d2-373b-45de-907b-53c9abbdf389 req-fb046e53-a5cb-42e1-b904-c8a75469bdfd service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:23.074601 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-eb97d6d2-373b-45de-907b-53c9abbdf389 req-fb046e53-a5cb-42e1-b904-c8a75469bdfd service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:23.075043 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-eb97d6d2-373b-45de-907b-53c9abbdf389 req-fb046e53-a5cb-42e1-b904-c8a75469bdfd service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:23.085958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-eb97d6d2-373b-45de-907b-53c9abbdf389 req-fb046e53-a5cb-42e1-b904-c8a75469bdfd service nova] Creating event network-vif-plugged:900a73f5-8be4-4458-b1a2-c46381499c03 for instance 49659f3e-6163-4c23-80d7-2be2b2c4119a on hv-cinder-85391 Aug 25 05:27:23.090932 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-eb97d6d2-373b-45de-907b-53c9abbdf389 req-fb046e53-a5cb-42e1-b904-c8a75469bdfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030813 Aug 25 05:27:23.091515 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 522/1049] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:27:23.965358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:23.965984 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:23.972696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:23.973163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:23.973583 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:23.974541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:23.974982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:23.975392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:24.212609 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:24.220672 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a550bc3f-519b-4bb2-bd24-9f5c52dfa7a4 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1358 microversion: 2.1 time: 0.259843 Aug 25 05:27:24.221280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 528/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:23 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:25.243405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:25.245461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:25.250457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.250934 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.251363 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:25.252049 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.252503 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.252919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:25.400539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:25.408345 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-eb551313-1c23-4b51-b895-f4d38e401e8e tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1546 microversion: 2.1 time: 0.169630 Aug 25 05:27:25.410267 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 523/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:25 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:25.432962 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:25.434189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:25.449630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.450118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.450556 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:25.451249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.451696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.452123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:25.600093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:25.608505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a180a497-a805-4953-a235-64c09d9274ae tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1546 microversion: 2.1 time: 0.179274 Aug 25 05:27:25.609081 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 529/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:25 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:25.628878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:25.633785 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:25.636522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Searching by: {'deleted': False, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd'} {{(pid=121310) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 05:27:25.642317 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.642792 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.643253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:25.643976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.644423 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.644850 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:25.735309 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.multi_cell_list [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121310) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 05:27:25.846825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f7fd0fab-859f-4482-94d0-86fd5b490b0d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221854 Aug 25 05:27:25.847413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 524/1053] 10.222.0.16 () {58 vars in 1125 bytes} [Thu Aug 25 05:27:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:27:25.862782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:25.864477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:25.872883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.874154 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.874818 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:25.876352 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:25.877464 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:25.879021 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:26.017418 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:26.027157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-083bf6fd-ef72-4483-bc0c-3c800a0c9efa tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1546 microversion: 2.1 time: 0.171811 Aug 25 05:27:26.027943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 530/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:25 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:28.211298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6deb2c45-0227-4f84-8891-0aa1f82e5eab"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:27:28.214804 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:28.239832 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:28.239832 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:28.239832 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:28.239832 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:28.240238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:28.240238 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:29.278846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e3840ab9-7466-4805-9d13-53676c57f90c tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.071403 Aug 25 05:27:29.285296 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 525/1055] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Aug 25 05:27:28 2022] POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments => generated 194 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:27:36.566558 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=7 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:36.567386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=23 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:36.742955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a821c58c-3c83-4e57-85c1-6519e6a1009e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Action: 'create', calling method: .version_select at 0x7f2423ecbdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1690370930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9/A7M9RDagx593Dg3jwk51l61XDwqcfSXpjbGPpZvIghULCFonRg5USdlAbFp+5cJcpbFFHjtW2kec9zRufGwvklCTh8oH6VSD+oagMdC5GzdfJvsW43rq8a0S8ZPPnw=="}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:27:36.761011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-a821c58c-3c83-4e57-85c1-6519e6a1009e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:27:36.764994 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-a821c58c-3c83-4e57-85c1-6519e6a1009e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for user 8920a7e7625b46f59c3a89e2930f6535 and project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'key_pairs'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:27:36.871380 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a821c58c-3c83-4e57-85c1-6519e6a1009e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.310997 Aug 25 05:27:36.871994 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 531/1056] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:27:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:27:36.988120 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:27:36.992219 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:36.993811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:37.000124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:37.000635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:37.001067 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:37.001797 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:37.002250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:37.002665 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:37.140198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:37.148510 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7003f20b-c4d2-41cb-9437-a3b4c2c2379d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1592 microversion: 2.1 time: 0.161870 Aug 25 05:27:37.149083 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 526/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:36 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1592 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:27:40.433903 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-48d549b6-e16c-45d1-b243-8abc9d33d9c8 req-0b3c242c-44da-4aa7-a165-97e2780bb79e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49659f3e-6163-4c23-80d7-2be2b2c4119a", "tag": "900a73f5-8be4-4458-b1a2-c46381499c03"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:27:40.445729 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-48d549b6-e16c-45d1-b243-8abc9d33d9c8 req-0b3c242c-44da-4aa7-a165-97e2780bb79e service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:40.446512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-48d549b6-e16c-45d1-b243-8abc9d33d9c8 req-0b3c242c-44da-4aa7-a165-97e2780bb79e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:40.447100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-48d549b6-e16c-45d1-b243-8abc9d33d9c8 req-0b3c242c-44da-4aa7-a165-97e2780bb79e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:40.459763 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-48d549b6-e16c-45d1-b243-8abc9d33d9c8 req-0b3c242c-44da-4aa7-a165-97e2780bb79e service nova] Creating event network-changed:900a73f5-8be4-4458-b1a2-c46381499c03 for instance 49659f3e-6163-4c23-80d7-2be2b2c4119a on hv-cinder-85391 Aug 25 05:27:40.467946 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-48d549b6-e16c-45d1-b243-8abc9d33d9c8 req-0b3c242c-44da-4aa7-a165-97e2780bb79e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038812 Aug 25 05:27:40.469106 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 532/1058] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:27:43.118513 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1932550627"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:27:43.119066 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:43.126541 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:43.127251 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:43.127758 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:43.128448 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:43.129137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:43.129663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:43.261038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.network.security_group_api [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Adding security group 5352878f-9f0a-4051-a612-1efc68be9c81 to port 900a73f5-8be4-4458-b1a2-c46381499c03 Aug 25 05:27:43.688290 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fc8092e9-96de-4fe6-b5a4-305a84e9a25f tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/action" status: 202 len: 0 microversion: 2.1 time: 0.573659 Aug 25 05:27:43.692692 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 527/1059] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:27:43 2022] POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:27:43.698061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-a2c07375-e146-493d-b7cf-796331d375ce req-6a84d584-4807-4a22-b981-8e40cc7c879d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49659f3e-6163-4c23-80d7-2be2b2c4119a", "tag": "900a73f5-8be4-4458-b1a2-c46381499c03"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:27:43.698565 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:27:43.698985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:27:43.705143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:43.705661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:43.711569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:43.711569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:43.711569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:43.711569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:43.711967 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a2c07375-e146-493d-b7cf-796331d375ce req-6a84d584-4807-4a22-b981-8e40cc7c879d service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:27:43.711967 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a2c07375-e146-493d-b7cf-796331d375ce req-6a84d584-4807-4a22-b981-8e40cc7c879d service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:27:43.711967 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a2c07375-e146-493d-b7cf-796331d375ce req-6a84d584-4807-4a22-b981-8e40cc7c879d service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:27:43.722716 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-a2c07375-e146-493d-b7cf-796331d375ce req-6a84d584-4807-4a22-b981-8e40cc7c879d service nova] Creating event network-changed:900a73f5-8be4-4458-b1a2-c46381499c03 for instance 49659f3e-6163-4c23-80d7-2be2b2c4119a on hv-cinder-85391 Aug 25 05:27:43.728519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-a2c07375-e146-493d-b7cf-796331d375ce req-6a84d584-4807-4a22-b981-8e40cc7c879d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035725 Aug 25 05:27:43.729488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 533/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:27:43.876330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:27:43.884870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-575efe03-524c-4bf3-84b4-96604d9a787d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1758 microversion: 2.1 time: 0.190808 Aug 25 05:27:43.885557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 528/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:27:43 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:03.657192 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=4 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:03.657993 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:03.658635 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=4 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:03.662703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-346110130", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1690370930", "security_groups": [{"name": "tempest-secgroup-smoke-680604050"}], "block_device_mapping_v2": [{"uuid": "df0578e4-f95c-4ce4-92c4-09ff30a281eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fe1a6d4-dbf8-431a-b133-4fa967b7e77d"}]}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:28:03.775992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] validate_networks() for [('7fe1a6d4-dbf8-431a-b133-4fa967b7e77d', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:28:04.143900 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:28:04.144320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:28:04.144793 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:28:04.145201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:28:04.145645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:28:04.154463 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:04.154941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:04.155372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:04.156100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:04.156578 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:04.156997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:04.174955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:28:04.178914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for user 8920a7e7625b46f59c3a89e2930f6535 and project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:28:04.235374 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:28:04.237626 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df0578e4-f95c-4ce4-92c4-09ff30a281eb',volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:28:04.629215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4ffc0b2d-0043-4d9b-972b-6192ec8e412e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.973392 Aug 25 05:28:04.630084 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 534/1062] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:28:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:28:04.640918 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-33a1a592-be1f-4857-aaa5-4abbc46cb67e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:04.641532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-33a1a592-be1f-4857-aaa5-4abbc46cb67e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:04.644824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=15 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:04.645498 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:04.701239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-33a1a592-be1f-4857-aaa5-4abbc46cb67e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:04.709221 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-33a1a592-be1f-4857-aaa5-4abbc46cb67e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1094 microversion: 2.1 time: 0.072171 Aug 25 05:28:04.709811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 529/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:04 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:05.730549 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:05.731157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:05.738236 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:05.742866 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:05.742866 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:05.742866 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:05.742866 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:05.743859 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:05.800592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:05.809012 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-105f2fa0-5703-48e9-973e-e6c20c252439 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1144 microversion: 2.1 time: 0.083454 Aug 25 05:28:05.809596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 535/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:05 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:06.829832 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:06.830422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:06.838455 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:06.838930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:06.839428 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:06.840143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:06.840585 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:06.841018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:06.916115 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:06.923729 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4a2415bb-06c3-40bf-a8a4-c43df5f95120 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1200 microversion: 2.1 time: 0.097861 Aug 25 05:28:06.924297 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 530/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:06 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:07.950308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:07.951004 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:07.958345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:07.958895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:07.960385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:07.960385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:07.960732 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:07.960830 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:08.101420 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:08.109682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-800617e9-9070-4ab2-905d-8d94ac6c9b5b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1277 microversion: 2.1 time: 0.163777 Aug 25 05:28:08.110356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 536/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:07 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:08.433477 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-a883e26b-9db4-44b8-b0c0-79012690e4e9 req-937b562f-c963-45a4-99cc-3c9b78d1e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285ea616-3317-47c3-9f8f-3ed6bc48b5ee", "tag": "0cf331ed-ea11-4879-b5b1-0e0332ecea09"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:28:08.443215 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-a883e26b-9db4-44b8-b0c0-79012690e4e9 req-937b562f-c963-45a4-99cc-3c9b78d1e6b8 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:08.443685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-a883e26b-9db4-44b8-b0c0-79012690e4e9 req-937b562f-c963-45a4-99cc-3c9b78d1e6b8 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:08.444135 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-a883e26b-9db4-44b8-b0c0-79012690e4e9 req-937b562f-c963-45a4-99cc-3c9b78d1e6b8 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:08.455385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-a883e26b-9db4-44b8-b0c0-79012690e4e9 req-937b562f-c963-45a4-99cc-3c9b78d1e6b8 service nova] Creating event network-changed:0cf331ed-ea11-4879-b5b1-0e0332ecea09 for instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee on hv-cinder-85391 Aug 25 05:28:08.460527 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-a883e26b-9db4-44b8-b0c0-79012690e4e9 req-937b562f-c963-45a4-99cc-3c9b78d1e6b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031291 Aug 25 05:28:08.461153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 531/1067] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:28:09.135139 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:09.135783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:09.142196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:09.142670 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:09.143092 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:09.143771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:09.144211 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:09.144623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:09.282341 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:09.290620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-a1bd3f22-ca94-4b35-8512-14efe853b32d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.158693 Aug 25 05:28:09.291219 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 537/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:09 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:10.313604 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:10.314294 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:10.320470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:10.320944 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:10.321395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:10.322124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:10.322572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:10.322984 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:10.449609 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:10.457185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6c1c8ad4-cadf-416c-ab47-8384e04da85a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.148272 Aug 25 05:28:10.457775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 532/1069] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:10 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:11.477198 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:11.477831 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:11.484249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:11.484755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:11.485185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:11.485901 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:11.486350 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:11.486772 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:11.613392 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:11.621478 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-b957ab10-ad12-4042-8ee3-14c99cbbd410 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.148394 Aug 25 05:28:11.622070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 538/1070] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:11 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:12.642000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:12.642594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:12.648912 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:12.649982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:12.650407 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:12.651082 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:12.651524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:12.651935 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:12.780569 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:12.788123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-95bcda82-85dd-4927-8855-4ba12a373895 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.149940 Aug 25 05:28:12.788687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 533/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:12 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:13.809069 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:13.809621 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:13.815894 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:13.816362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:13.816790 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:13.817462 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:13.817934 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:13.818345 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:13.949982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:13.957571 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-58649e1a-ada1-4583-afe0-15e3a0c35dd3 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.153255 Aug 25 05:28:13.958148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 539/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:13 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:14.978041 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:14.978652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:14.981119 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:14.985915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:14.995364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:14.995364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:14.995364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:14.995364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:14.995723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:15.116062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:15.124315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e5edf3a6-0f6b-49e1-ab33-22f875172504 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.150500 Aug 25 05:28:15.124887 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 534/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:14 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:16.145091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:16.145739 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:16.147555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:16.148201 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=6 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:16.153932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:16.154409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:16.154839 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:16.155528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:16.156003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:16.156424 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:16.288023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:16.295640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-eeeb90cb-1def-4122-9056-f8a81963ad9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.154444 Aug 25 05:28:16.296204 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 540/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:16 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:17.315899 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:17.316502 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:17.322911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:17.323388 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:17.323819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:17.324500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:17.324949 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:17.325371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:17.454606 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:17.462818 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-af4aa70e-d8f1-4f49-b274-36ea98a94863 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.150746 Aug 25 05:28:17.463381 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 535/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:17 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:18.484067 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:18.484692 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:18.491114 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:18.491595 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:18.492028 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:18.493385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:18.493875 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:18.494301 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:18.624500 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:18.632348 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-570727bb-9d7c-4d0f-821d-d0e711b19d1a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.152251 Aug 25 05:28:18.632909 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 541/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:18 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:19.652247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:19.652876 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:19.659240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:19.659719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:19.660143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:19.660821 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:19.661262 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:19.661702 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:19.790403 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:19.797978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5250e276-d932-4cb9-a1d1-23e13c55a3cd tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.149598 Aug 25 05:28:19.798548 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 536/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:19 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:20.819140 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:20.819747 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:20.826730 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:20.827205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:20.827633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:20.828349 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:20.828799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:20.829218 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:20.955546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:20.963711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c70be50b-06f8-4961-8f42-118e9cf8f106 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.148435 Aug 25 05:28:20.964293 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 542/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:20 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:21.276588 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-3aa39b14-de4f-4eb4-9f60-2bd86cc3cf2c req-d166b940-7a90-4be1-8569-37710d2bdd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285ea616-3317-47c3-9f8f-3ed6bc48b5ee", "name": "network-vif-plugged", "status": "completed", "tag": "0cf331ed-ea11-4879-b5b1-0e0332ecea09"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:28:21.286314 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-3aa39b14-de4f-4eb4-9f60-2bd86cc3cf2c req-d166b940-7a90-4be1-8569-37710d2bdd7e service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:21.286778 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-3aa39b14-de4f-4eb4-9f60-2bd86cc3cf2c req-d166b940-7a90-4be1-8569-37710d2bdd7e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:21.287194 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-3aa39b14-de4f-4eb4-9f60-2bd86cc3cf2c req-d166b940-7a90-4be1-8569-37710d2bdd7e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:21.300193 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-3aa39b14-de4f-4eb4-9f60-2bd86cc3cf2c req-d166b940-7a90-4be1-8569-37710d2bdd7e service nova] Creating event network-vif-plugged:0cf331ed-ea11-4879-b5b1-0e0332ecea09 for instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee on hv-cinder-85391 Aug 25 05:28:21.306173 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-3aa39b14-de4f-4eb4-9f60-2bd86cc3cf2c req-d166b940-7a90-4be1-8569-37710d2bdd7e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033362 Aug 25 05:28:21.306767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 537/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:28:21.984239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:21.984867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:21.991190 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:21.991661 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:21.992306 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:21.992797 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:21.993238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:21.993691 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:22.125120 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:22.132850 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-589d8dbd-2acc-4ec2-b2aa-249b3a790643 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.152477 Aug 25 05:28:22.133415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 543/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:21 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:23.153888 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:23.154582 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:23.161078 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:23.161553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:23.162015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:23.162724 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:23.163174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:23.163621 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:23.293430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:23.301026 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b4042d31-be36-4230-8026-9dddb657bffc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1265 microversion: 2.1 time: 0.151371 Aug 25 05:28:23.301612 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 538/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:23 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:24.322097 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:24.323748 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:24.329723 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:24.330200 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:24.330626 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:24.331307 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:24.331757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:24.332175 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:24.458832 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:24.466478 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1de7e23e-4dd9-4c50-9cad-1b79390d1058 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1453 microversion: 2.1 time: 0.149126 Aug 25 05:28:24.467041 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 544/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:24 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:24.486972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:24.487517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:24.494498 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:24.494971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:24.495401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:24.496084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:24.496538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:24.496959 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:24.622600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:24.630229 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5879b795-b1cb-488b-8006-fd71e2dc5623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1453 microversion: 2.1 time: 0.147104 Aug 25 05:28:24.630791 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 539/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:24 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:26.849535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-772ac9c0-f6fc-4f74-b11f-fad3409e74dd req-73432fc1-2b87-435a-b77d-18506b207b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285ea616-3317-47c3-9f8f-3ed6bc48b5ee", "tag": "0cf331ed-ea11-4879-b5b1-0e0332ecea09"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:28:26.860007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-772ac9c0-f6fc-4f74-b11f-fad3409e74dd req-73432fc1-2b87-435a-b77d-18506b207b4a service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:26.860510 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-772ac9c0-f6fc-4f74-b11f-fad3409e74dd req-73432fc1-2b87-435a-b77d-18506b207b4a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:26.860937 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-772ac9c0-f6fc-4f74-b11f-fad3409e74dd req-73432fc1-2b87-435a-b77d-18506b207b4a service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:26.873475 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-772ac9c0-f6fc-4f74-b11f-fad3409e74dd req-73432fc1-2b87-435a-b77d-18506b207b4a service nova] Creating event network-changed:0cf331ed-ea11-4879-b5b1-0e0332ecea09 for instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee on hv-cinder-85391 Aug 25 05:28:26.878744 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-772ac9c0-f6fc-4f74-b11f-fad3409e74dd req-73432fc1-2b87-435a-b77d-18506b207b4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089966 Aug 25 05:28:26.879606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 545/1084] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:28:55.229036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:28:55.231272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:55.233468 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=24 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:55.234149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=52 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:55.239323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:55.244072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:55.244072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:55.244072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:55.244072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:55.244451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:55.447996 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-94cf1a13-62e7-4596-866f-082090f31cb1 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/action" status: 202 len: 0 microversion: 2.1 time: 0.222989 Aug 25 05:28:55.448836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 540/1085] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:28:55 2022] POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:28:55.454704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:55.455623 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=64 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:28:55.459603 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:55.460302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:55.466966 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:55.467440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:55.467863 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:55.468541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:55.468983 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:55.469394 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:55.659186 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:55.667780 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-840a9bd0-280b-4a5e-ac01-a2ef7a994f3a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1750 microversion: 2.1 time: 0.214733 Aug 25 05:28:55.668365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 546/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:55 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:56.691873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:56.692487 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:56.699761 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:56.700235 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:56.700661 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:56.701330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:56.701895 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:56.702310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:56.893933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:56.902833 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a8910527-eb2c-438c-960f-1d3ee41b6603 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.215960 Aug 25 05:28:56.903395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 541/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:56 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:57.924070 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:57.924675 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:57.931101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:57.931568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:57.932015 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:57.932687 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:57.933158 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:57.933570 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:58.080020 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:58.083938 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-98f5d653-f7d6-4015-8358-cf1666c9d987 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.163787 Aug 25 05:28:58.084507 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 547/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:57 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:28:59.106725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:28:59.107368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:28:59.113806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:59.114285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:59.114721 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:59.115405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:28:59.115853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:28:59.116272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:28:59.255516 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:28:59.263583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a2d81540-160c-4074-a2ff-f090f1c755fb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.161300 Aug 25 05:28:59.264139 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 542/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:28:59 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:29:00.285440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:29:00.285997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:29:00.292982 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:00.293453 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:00.293904 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:00.294582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:00.295025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:00.295439 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:00.434582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:29:00.442669 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9525d332-46e4-4d72-8cf6-f0f1427ce789 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.161200 Aug 25 05:29:00.443238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 548/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:29:00 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:29:01.464305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:29:01.464904 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:29:01.471402 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:01.476820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:01.476820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:01.476820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:01.476820 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:01.477210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:01.614498 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:29:01.622664 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ee822bbf-be26-4e26-8cd2-21e943bb9a78 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.162775 Aug 25 05:29:01.623218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 543/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:29:01 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:29:02.642760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:29:02.643365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:29:02.649711 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:02.650186 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:02.650608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:02.651282 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:02.651721 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:02.652132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:02.790023 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:29:02.799592 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c7b288bd-1337-4a0f-bcd6-855abec16eea tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.160496 Aug 25 05:29:02.799916 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 549/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:29:02 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:29:03.820247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:29:03.820855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:29:03.827940 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:03.828432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:03.828850 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:03.829532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:03.830005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:03.830422 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:03.969350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:29:03.977802 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-12324663-9d1c-4cc2-a4ba-f2b9798fbcda tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.161469 Aug 25 05:29:03.978372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 544/1093] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:29:03 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:29:04.999187 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:29:04.999782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:29:05.006223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:05.006705 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:05.007133 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:05.007815 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:05.008264 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:05.008681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:05.149230 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:29:05.158021 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4d787aa3-03a6-4c71-97f2-8f46e8ae03f0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.162722 Aug 25 05:29:05.158586 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 550/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:29:04 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:29:06.178884 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:29:06.179484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:29:06.182104 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:29:06.182241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Thu Aug 25 05:29:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a (ip 10.222.0.16) !!! Aug 25 05:29:06.189439 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:06.190002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:06.190434 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:06.191123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:06.191602 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:06.192019 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:06.335871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:29:06.343987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9ed90ed9-4640-4797-83c8-51b4d668434a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1755 microversion: 2.1 time: 0.168988 Aug 25 05:29:06.344558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 545/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:29:06 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:29:07.365616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:29:07.366241 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:29:07.373469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:07.373974 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:07.374404 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:07.375089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:29:07.375537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:29:07.375956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:29:07.519841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:29:07.528517 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3a24eb1f-a0b2-4705-93ce-b3bbcb11a923 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1758 microversion: 2.1 time: 0.166772 Aug 25 05:29:07.529082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 551/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:29:07 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:04.154161 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1932550627"}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:04.154688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:04.156917 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=12 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:04.157558 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:04.162287 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:04.162810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:04.163198 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:04.163885 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:04.164333 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:04.164748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:04.290328 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.network.security_group_api [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Removing security group 5352878f-9f0a-4051-a612-1efc68be9c81 from port 900a73f5-8be4-4458-b1a2-c46381499c03 Aug 25 05:30:04.661675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4a8d1e67-9b82-4180-a326-69921f7568a0 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/action" status: 202 len: 0 microversion: 2.1 time: 0.511350 Aug 25 05:30:04.662528 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 546/1097] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:30:04 2022] POST /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:30:04.670762 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-ecc95470-8bd5-4da6-bdac-6dbb6d49e437 req-772b6995-c253-42a1-aac9-dd2a11b48d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49659f3e-6163-4c23-80d7-2be2b2c4119a", "tag": "900a73f5-8be4-4458-b1a2-c46381499c03"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:04.677947 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=12 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:04.678741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=36 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:04.683277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ecc95470-8bd5-4da6-bdac-6dbb6d49e437 req-772b6995-c253-42a1-aac9-dd2a11b48d7b service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:04.683756 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ecc95470-8bd5-4da6-bdac-6dbb6d49e437 req-772b6995-c253-42a1-aac9-dd2a11b48d7b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:04.684185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-ecc95470-8bd5-4da6-bdac-6dbb6d49e437 req-772b6995-c253-42a1-aac9-dd2a11b48d7b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:04.695344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-ecc95470-8bd5-4da6-bdac-6dbb6d49e437 req-772b6995-c253-42a1-aac9-dd2a11b48d7b service nova] Creating event network-changed:900a73f5-8be4-4458-b1a2-c46381499c03 for instance 49659f3e-6163-4c23-80d7-2be2b2c4119a on hv-cinder-85391 Aug 25 05:30:04.700897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-ecc95470-8bd5-4da6-bdac-6dbb6d49e437 req-772b6995-c253-42a1-aac9-dd2a11b48d7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033665 Aug 25 05:30:04.701873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 552/1098] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:06.107919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:06.108401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:06.115057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:06.115534 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:06.115962 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:06.116834 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:06.117288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:06.117738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:06.200563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lazy-loading 'services' on Instance uuid 49659f3e-6163-4c23-80d7-2be2b2c4119a {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:30:06.446564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-74904d48-62c7-43ee-bb98-4169aa8dca8d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments/6deb2c45-0227-4f84-8891-0aa1f82e5eab" status: 202 len: 0 microversion: 2.1 time: 0.342230 Aug 25 05:30:06.447667 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 547/1099] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:30:06 2022] DELETE /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments/6deb2c45-0227-4f84-8891-0aa1f82e5eab => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:30:06.457484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:06.460618 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:06.467286 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:06.467753 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:06.468185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:06.469025 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:06.469997 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:06.470471 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:06.500919 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1ed7c162-2045-43f1-85af-22942a6334eb tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049098 Aug 25 05:30:06.501477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 553/1100] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:30:06 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:06.715863 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-4bdc8f61-2170-4dcc-a31f-6deba9cacda4 req-7186f296-71d7-4ccc-97a1-bda509c7c2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49659f3e-6163-4c23-80d7-2be2b2c4119a", "tag": "900a73f5-8be4-4458-b1a2-c46381499c03"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:06.726460 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4bdc8f61-2170-4dcc-a31f-6deba9cacda4 req-7186f296-71d7-4ccc-97a1-bda509c7c2f5 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:06.726853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4bdc8f61-2170-4dcc-a31f-6deba9cacda4 req-7186f296-71d7-4ccc-97a1-bda509c7c2f5 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:06.727271 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4bdc8f61-2170-4dcc-a31f-6deba9cacda4 req-7186f296-71d7-4ccc-97a1-bda509c7c2f5 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:06.739733 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-4bdc8f61-2170-4dcc-a31f-6deba9cacda4 req-7186f296-71d7-4ccc-97a1-bda509c7c2f5 service nova] Creating event network-changed:900a73f5-8be4-4458-b1a2-c46381499c03 for instance 49659f3e-6163-4c23-80d7-2be2b2c4119a on hv-cinder-85391 Aug 25 05:30:06.748518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-4bdc8f61-2170-4dcc-a31f-6deba9cacda4 req-7186f296-71d7-4ccc-97a1-bda509c7c2f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Aug 25 05:30:06.748518 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 548/1101] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:07.513538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:07.517492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:07.524582 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:07.525134 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:07.525852 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:07.528122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:07.528600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:07.529062 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:07.560320 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-80ef5100-74fb-4d82-8b40-0b97e1a54e9d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050714 Aug 25 05:30:07.564996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 554/1102] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:30:07 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:08.573124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:08.575533 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:08.582433 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:08.582930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:08.583358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:08.584040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:08.584480 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:08.584892 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:08.613679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2c40078b-739b-4b08-b781-3e33ec1a6855 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045056 Aug 25 05:30:08.614225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 549/1103] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Aug 25 05:30:08 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 05:30:08.624659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:08.625135 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:08.631585 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:08.632059 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:08.632489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:08.633174 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:08.633651 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:08.634096 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:08.706971 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] HTTP exception thrown: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a is not attached to volume 6deb2c45-0227-4f84-8891-0aa1f82e5eab Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Request method failure captured: Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments/6deb2c45-0227-4f84-8891-0aa1f82e5eab HTTP/1.1 Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwgIVH6jK_Gy6gIUmeNzgyKD7yKxKX7BA1-kAas-3kX2g9jaRobKZ8vPlwrXQ_47x-qPpwW8KCXeyVOmsfaeZnkd_ZDn5Q0ndbyjqOCYgyA9gR6yg-sEvHCn7bnefrvTC4xZ-HlqenF26KJHo46iPDdl0mv3w2oTV8vBRw7v-lzRZrg Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: b0f35b076ec94efda11070e02d3a5acd Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-TestMinimumBasicScenario-1950521657 Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:30:08.709337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0f35b076ec94efda11070e02d3a5acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0f35b076ec94efda11070e02d3a5acd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0f35b076ec94efda11070e02d3a5acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0f35b076ec94efda11070e02d3a5acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-TestMinimumBasicScenario-1950521657 Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: b0f35b076ec94efda11070e02d3a5acd Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1950521657 Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-TestMinimumBasicScenario-1950521657-project Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: fb70879694d443df9b30ff172cfa39b4 Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-TestMinimumBasicScenario-1950521657-project Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:30:08.711053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a is not attached to volume 6deb2c45-0227-4f84-8891-0aa1f82e5eab Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'server_id': '49659f3e-6163-4c23-80d7-2be2b2c4119a', 'id': '6deb2c45-0227-4f84-8891-0aa1f82e5eab'} Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6deb2c45-0227-4f84-8891-0aa1f82e5eab. Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:30:08.711981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a is not attached to volume 6deb2c45-0227-4f84-8891-0aa1f82e5eab Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a is not attached to volume 6deb2c45-0227-4f84-8891-0aa1f82e5eab Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:08.713906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Returning 404 to user: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a is not attached to volume 6deb2c45-0227-4f84-8891-0aa1f82e5eab {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:30:08.715123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d670c9b8-3948-40d7-922e-73c3a74c696a tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments/6deb2c45-0227-4f84-8891-0aa1f82e5eab" status: 404 len: 154 microversion: 2.1 time: 0.090321 Aug 25 05:30:08.715123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 555/1104] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Aug 25 05:30:08 2022] DELETE /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a/os-volume_attachments/6deb2c45-0227-4f84-8891-0aa1f82e5eab => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:30:09.981291 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:09.981824 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:09.988483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:09.988953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:09.989376 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:09.990075 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:09.990514 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:09.990923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:10.018922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Going to try to terminate instance {{(pid=121310) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:30:10.351364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d520475c-725f-4cbd-8ae8-061f4bdca108 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 204 len: 0 microversion: 2.1 time: 0.373599 Aug 25 05:30:10.351954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 550/1105] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:30:09 2022] DELETE /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:30:10.359995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:10.360636 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:10.367179 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:10.367649 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:10.368078 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:10.368855 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:10.369302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:10.369758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:10.497066 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:10.504802 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0ef72771-e9ad-4475-bde4-ccecc2e29223 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1552 microversion: 2.1 time: 0.148672 Aug 25 05:30:10.505366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 556/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:10 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:11.526907 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:11.527608 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:11.534491 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:11.534967 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:11.535397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:11.536073 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:11.536517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:11.536930 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:11.666836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:11.675022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bb66134c-feee-4ebf-87b4-533136ce0f20 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1552 microversion: 2.1 time: 0.152355 Aug 25 05:30:11.675584 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 551/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:11 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:12.697759 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:12.699017 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:12.705972 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:12.706720 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:12.707366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:12.708277 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:12.708928 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:12.709690 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:12.853902 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:12.864516 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-819ac69d-5f0a-47cd-9abf-7ae05b54e96d tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1552 microversion: 2.1 time: 0.172590 Aug 25 05:30:12.865414 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 557/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:12 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:13.452145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-9a594079-4067-4135-8f77-768c94cfe9da req-761bc6b3-7b56-4813-937f-d03ab71a8c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49659f3e-6163-4c23-80d7-2be2b2c4119a", "name": "network-vif-deleted", "tag": "900a73f5-8be4-4458-b1a2-c46381499c03"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:13.462285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-9a594079-4067-4135-8f77-768c94cfe9da req-761bc6b3-7b56-4813-937f-d03ab71a8c60 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:13.463350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-9a594079-4067-4135-8f77-768c94cfe9da req-761bc6b3-7b56-4813-937f-d03ab71a8c60 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:13.463350 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-9a594079-4067-4135-8f77-768c94cfe9da req-761bc6b3-7b56-4813-937f-d03ab71a8c60 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:13.475046 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-9a594079-4067-4135-8f77-768c94cfe9da req-761bc6b3-7b56-4813-937f-d03ab71a8c60 service nova] Creating event network-vif-deleted:900a73f5-8be4-4458-b1a2-c46381499c03 for instance 49659f3e-6163-4c23-80d7-2be2b2c4119a on hv-cinder-85391 Aug 25 05:30:13.479694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-9a594079-4067-4135-8f77-768c94cfe9da req-761bc6b3-7b56-4813-937f-d03ab71a8c60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126163 Aug 25 05:30:13.480304 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 552/1109] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:13.886373 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:13.886906 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:13.894099 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:13.894568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:13.894995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:13.895681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:13.896125 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:13.896542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:13.927214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:13.927682 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:13.928109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:13.928546 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lazy-loading 'fault' on Instance uuid 49659f3e-6163-4c23-80d7-2be2b2c4119a {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:30:13.969075 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb70879694d443df9b30ff172cfa39b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f35b076ec94efda11070e02d3a5acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:13.977061 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9648afad-ab55-45dd-9bf2-74227e5e35c8 tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 200 len: 1348 microversion: 2.1 time: 0.094773 Aug 25 05:30:13.977639 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 558/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:13 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:15.000031 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:15.000721 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [instance: 49659f3e-6163-4c23-80d7-2be2b2c4119a] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:15.007441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:15.007910 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:15.008330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:15.009002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:15.009440 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:15.009881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:15.025202 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] HTTP exception thrown: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a could not be found. Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Request method failure captured: Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a HTTP/1.1 Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwgIVH6jK_Gy6gIUmeNzgyKD7yKxKX7BA1-kAas-3kX2g9jaRobKZ8vPlwrXQ_47x-qPpwW8KCXeyVOmsfaeZnkd_ZDn5Q0ndbyjqOCYgyA9gR6yg-sEvHCn7bnefrvTC4xZ-HlqenF26KJHo46iPDdl0mv3w2oTV8vBRw7v-lzRZrg Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: b0f35b076ec94efda11070e02d3a5acd Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-TestMinimumBasicScenario-1950521657 Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:30:15.026848 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0f35b076ec94efda11070e02d3a5acd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b0f35b076ec94efda11070e02d3a5acd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b0f35b076ec94efda11070e02d3a5acd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b0f35b076ec94efda11070e02d3a5acd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-TestMinimumBasicScenario-1950521657 Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: b0f35b076ec94efda11070e02d3a5acd Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1950521657 Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-TestMinimumBasicScenario-1950521657-project Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: fb70879694d443df9b30ff172cfa39b4 Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-TestMinimumBasicScenario-1950521657-project Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a could not be found. Aug 25 05:30:15.028405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '49659f3e-6163-4c23-80d7-2be2b2c4119a'} Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a could not be found. Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:30:15.029258 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a could not be found. Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a could not be found. Aug 25 05:30:15.030617 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:30:15.031799 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Returning 404 to user: Instance 49659f3e-6163-4c23-80d7-2be2b2c4119a could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:30:15.031799 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5f857022-2aba-4a13-aa4f-8611343913ac tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a" status: 404 len: 111 microversion: 2.1 time: 0.033027 Aug 25 05:30:15.031799 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 553/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:14 2022] GET /compute/v2.1/servers/49659f3e-6163-4c23-80d7-2be2b2c4119a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:30:15.036833 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4c008b42-378a-4d25-abda-fb308509acbe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] Calling method '.version_select at 0x7f2423ce3d30>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:15.041354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c008b42-378a-4d25-abda-fb308509acbe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [4cc64825-3797-4ef0-aee4-18fd54fe91f5] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 05:30:16.048499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c008b42-378a-4d25-abda-fb308509acbe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] [4cc64825-3797-4ef0-aee4-18fd54fe91f5] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52394. Aug 25 05:30:16.157873 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4c008b42-378a-4d25-abda-fb308509acbe tempest-TestMinimumBasicScenario-1950521657 tempest-TestMinimumBasicScenario-1950521657-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-199753860" status: 202 len: 0 microversion: 2.1 time: 1.124681 Aug 25 05:30:16.158466 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 559/1112] 10.222.0.16 () {58 vars in 1269 bytes} [Thu Aug 25 05:30:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-199753860 => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:30:39.793862 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:39.794591 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:39.987808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0003a760-3482-430b-9137-bcb14fe0d90e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Action: 'create', calling method: .version_select at 0x7f2423bc99d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1545764982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL30wtwC0BSl72Z3eREwATDE/mjhwNGCwhfyxmu/5dxVMNGb9jHNvhlDY6hvgtpw9TmxBsoINi9p/Y8H3ebWBLjlf+Jdty8nbmTMU4vrR7WyRM4pEqx3HypHSC6TZA9riw=="}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:40.007162 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-0003a760-3482-430b-9137-bcb14fe0d90e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Getting quotas for project 52aad667fe8d4b6582a7e4340ecfe33f. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:30:40.011484 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-0003a760-3482-430b-9137-bcb14fe0d90e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Getting quotas for user 8a77b0db996b4bd58f2a92344a26fe78 and project 52aad667fe8d4b6582a7e4340ecfe33f. Resources: {'key_pairs'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:30:40.108801 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0003a760-3482-430b-9137-bcb14fe0d90e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.319724 Aug 25 05:30:40.109401 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 554/1113] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Aug 25 05:30:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:44.474923 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=40 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:44.475768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:44.480323 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:44.482506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:44.495553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:44.496202 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:44.496645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:44.498315 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:44.498788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:44.499492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:44.525574 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:30:44.890455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-485c660b-19e3-464c-bf00-e59142d04623 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 204 len: 0 microversion: 2.1 time: 0.416968 Aug 25 05:30:44.891046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 560/1114] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:30:44 2022] DELETE /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:30:44.899842 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:44.900451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:44.907651 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:44.910891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:44.910891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:44.910891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:44.910891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:44.911318 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:45.045755 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:45.054187 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1e861eca-fc1b-4ee9-8df8-70aa9d368dfa tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1577 microversion: 2.1 time: 0.158922 Aug 25 05:30:45.054810 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 555/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:44 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:46.076494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:46.077272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:46.084620 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:46.085122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:46.085543 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:46.086261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:46.086705 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:46.087115 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:46.223276 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:46.234146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-aace0274-2e60-4768-b017-e25f444f1a08 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1577 microversion: 2.1 time: 0.161848 Aug 25 05:30:46.235465 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 561/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:46 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:47.256247 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:47.257003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:47.263785 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:47.264265 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:47.264695 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:47.265407 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:47.265886 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:47.266323 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:47.448191 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:47.455986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e5d062a9-a686-48a0-94dc-456eeeac5a93 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1577 microversion: 2.1 time: 0.203783 Aug 25 05:30:47.457306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 556/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:47 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:47.808187 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-e2028bb7-37ad-4a82-88e1-611c891f9e34 req-781c0c43-0a1c-43c0-a295-afbafb435ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285ea616-3317-47c3-9f8f-3ed6bc48b5ee", "name": "network-vif-deleted", "tag": "0cf331ed-ea11-4879-b5b1-0e0332ecea09"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:47.819735 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-e2028bb7-37ad-4a82-88e1-611c891f9e34 req-781c0c43-0a1c-43c0-a295-afbafb435ea0 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:47.820212 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-e2028bb7-37ad-4a82-88e1-611c891f9e34 req-781c0c43-0a1c-43c0-a295-afbafb435ea0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:47.820637 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-e2028bb7-37ad-4a82-88e1-611c891f9e34 req-781c0c43-0a1c-43c0-a295-afbafb435ea0 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:47.832650 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-e2028bb7-37ad-4a82-88e1-611c891f9e34 req-781c0c43-0a1c-43c0-a295-afbafb435ea0 service nova] Creating event network-vif-deleted:0cf331ed-ea11-4879-b5b1-0e0332ecea09 for instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee on hv-cinder-85391 Aug 25 05:30:47.837958 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-e2028bb7-37ad-4a82-88e1-611c891f9e34 req-781c0c43-0a1c-43c0-a295-afbafb435ea0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Aug 25 05:30:47.838564 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 562/1118] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:48.479999 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:48.484393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:48.490295 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:48.490900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:48.491493 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:48.492395 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:48.493239 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:48.493813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:48.564472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:48.572947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f1abbadb-0c08-4cd6-a90f-c809e1456202 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 200 len: 1225 microversion: 2.1 time: 0.098812 Aug 25 05:30:48.573517 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 557/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:48 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:49.594451 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:49.595060 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:49.602253 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:49.602760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:49.603196 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:49.603883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:49.604333 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:49.604842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:49.618464 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] HTTP exception thrown: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Request method failure captured: Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee HTTP/1.1 Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwhCrEl0jI2vyzjiDUgYCAPhrOT7wAsBelgK4a1E2C673fM35DbKRXAYyh--AesNKSWr8WRmgUpq77rfSvm4TW3M-5Tr-mNnJ7qgDT4cnYMAZG4R5ZEfwWY3YSiJSpT1dT_Gz59gDERXhO6ZDm9Br4VrmIL2VmiazEKZV7H0E3jkcH8 Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:30:49.620347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5223392ed2dc4eff871b9e788e4d677e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-TestVolumeBootPattern-658762128 Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 8920a7e7625b46f59c3a89e2930f6535 Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:30:49.622183 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '285ea616-3317-47c3-9f8f-3ed6bc48b5ee'} Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:30:49.623102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:30:49.624598 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:30:49.626121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Returning 404 to user: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:30:49.626121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7ca8698e-5d36-4ad6-90c3-e9f5d8130061 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 404 len: 111 microversion: 2.1 time: 0.031712 Aug 25 05:30:49.626121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 563/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:49 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:30:49.720674 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-336778428", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1690370930", "security_groups": [{"name": "tempest-secgroup-smoke-680604050"}], "block_device_mapping_v2": [{"uuid": "df0578e4-f95c-4ce4-92c4-09ff30a281eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fe1a6d4-dbf8-431a-b133-4fa967b7e77d"}]}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:49.837673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] validate_networks() for [('7fe1a6d4-dbf8-431a-b133-4fa967b7e77d', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:30:50.018372 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=4 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:30:50.470392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:30:50.470816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:30:50.471391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:30:50.471942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:30:50.473192 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:30:50.482707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:50.483182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:50.483614 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:50.484338 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:50.484788 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:50.485206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:50.502149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:30:50.506147 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for user 8920a7e7625b46f59c3a89e2930f6535 and project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:30:50.566014 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:30:50.578675 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df0578e4-f95c-4ce4-92c4-09ff30a281eb',volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:30:50.978274 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-2aaefeed-f9d1-4224-861d-cde8fe9c9a4c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.261385 Aug 25 05:30:50.979149 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 558/1121] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:30:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:30:50.991701 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bec5cda6-46f2-4443-b174-0a8e3eb5c8cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:50.992446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bec5cda6-46f2-4443-b174-0a8e3eb5c8cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:51.050992 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bec5cda6-46f2-4443-b174-0a8e3eb5c8cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:51.058581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bec5cda6-46f2-4443-b174-0a8e3eb5c8cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1094 microversion: 2.1 time: 0.071159 Aug 25 05:30:51.059137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 564/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:50 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:30:52.083754 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:52.084336 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:52.090564 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:52.091038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:52.091463 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:52.092144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:52.092589 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:52.093040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:52.158631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:52.167529 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-810f020f-7c13-4533-a8f4-86d9cf567789 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1144 microversion: 2.1 time: 0.088159 Aug 25 05:30:52.168308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 559/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:52 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:53.187841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:53.190057 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:53.194915 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:53.195397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:53.195821 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:53.196502 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:53.196943 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:53.197354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:53.259703 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:53.267302 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-77feec80-50e3-4c4e-a098-e7907201210e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1200 microversion: 2.1 time: 0.083644 Aug 25 05:30:53.267900 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 565/1124] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:53 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:54.288218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:54.290583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:54.295509 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:54.296018 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:54.296442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:54.297122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:54.297563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:54.298015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:54.500879 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:54.508986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-36860bc2-0e78-48d4-be26-92eb0938cf4f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1277 microversion: 2.1 time: 0.224650 Aug 25 05:30:54.509606 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 560/1125] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:54 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:54.902189 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-6871bd8d-3e4f-43e3-9811-d73d2c863b50 req-a70dc808-a286-4a5a-b6b7-e566071196fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a10724-ad1c-4496-8e15-a75869e1debe", "tag": "f9f79aa8-d802-4b1a-89ca-cc34588990e3"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:30:54.912614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6871bd8d-3e4f-43e3-9811-d73d2c863b50 req-a70dc808-a286-4a5a-b6b7-e566071196fa service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:54.913118 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6871bd8d-3e4f-43e3-9811-d73d2c863b50 req-a70dc808-a286-4a5a-b6b7-e566071196fa service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:54.913547 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-6871bd8d-3e4f-43e3-9811-d73d2c863b50 req-a70dc808-a286-4a5a-b6b7-e566071196fa service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:54.925051 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-6871bd8d-3e4f-43e3-9811-d73d2c863b50 req-a70dc808-a286-4a5a-b6b7-e566071196fa service nova] Creating event network-changed:f9f79aa8-d802-4b1a-89ca-cc34588990e3 for instance 79a10724-ad1c-4496-8e15-a75869e1debe on hv-cinder-85391 Aug 25 05:30:54.930768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-6871bd8d-3e4f-43e3-9811-d73d2c863b50 req-a70dc808-a286-4a5a-b6b7-e566071196fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032322 Aug 25 05:30:54.931370 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 566/1126] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:30:55.529789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:55.530388 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:55.537367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:55.537870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:55.538298 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:55.538997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:55.539436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:55.539846 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:55.741305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:55.749471 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e0e15f9d-cc94-46b9-ad2f-3966e34adebb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.223545 Aug 25 05:30:55.750072 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 561/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:55 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:30:56.772488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:56.773110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:56.779255 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:56.779728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:56.780155 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:56.780836 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:56.781283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:56.781740 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:56.917411 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:56.925193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d7bc110a-1cbd-49ad-b390-687f514f31f1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.158103 Aug 25 05:30:56.925788 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 567/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:56 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:57.945315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:57.945950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:57.952276 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:57.952744 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:57.953168 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:57.953873 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:57.954346 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:57.954760 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:58.081985 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:58.089790 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e1b71c8a-ef3e-4c72-9b32-3857f751433b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.148278 Aug 25 05:30:58.090354 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 562/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:57 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:30:59.111249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:30:59.111856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:30:59.118271 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:59.118749 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:59.119177 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:59.119862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:30:59.120308 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:30:59.120726 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:30:59.252137 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:30:59.259847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-69547dc3-952a-49ad-89ff-6be45128f78a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.152487 Aug 25 05:30:59.260411 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 568/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:30:59 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:00.280156 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:00.280822 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:00.287580 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:00.288058 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:00.288486 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:00.289171 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:00.289639 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:00.290062 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:00.421461 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:00.429029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-360fa889-985a-4758-bc56-8e5fa5dc91bc tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.152650 Aug 25 05:31:00.429623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 563/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:00 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:01.449758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:01.456973 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:01.456973 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:01.457568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:01.458084 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:01.458535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:01.459242 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:01.459696 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:01.460122 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:01.593438 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:01.602113 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-e8ea2b85-b87c-48e1-8e0a-6e4da058ef3c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.156318 Aug 25 05:31:01.602710 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 569/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:01 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:02.623248 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:02.628129 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:02.628129 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:02.628129 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=6 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:02.632340 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:02.632865 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:02.633286 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:02.634003 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:02.634442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:02.634855 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:02.761319 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:02.768874 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-9db8d8b2-eeec-4cee-9dee-88bc5e37f3f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.149680 Aug 25 05:31:02.769425 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 564/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:02 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:03.789110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:03.789739 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:03.796029 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:03.796499 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:03.796924 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:03.797611 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:03.798069 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:03.798482 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:03.926541 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:03.934054 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-773c564f-207c-49b5-a824-92d08db4de29 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.148746 Aug 25 05:31:03.934614 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 570/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:03 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:04.515948 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-434521280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1545764982", "security_groups": [{"name": "tempest-secgroup-smoke-1789313452"}], "networks": [{"uuid": "454c691d-682d-4b5a-86ac-287c2b4ee4b0"}], "block_device_mapping_v2": [{"uuid": "273fb191-f2b6-4682-ac88-e8a200561927", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:04.628721 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.network.neutron [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] validate_networks() for [('454c691d-682d-4b5a-86ac-287c2b4ee4b0', None, None, None, None, None)] {{(pid=121310) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:31:04.954737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:04.955336 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:04.962204 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:04.962679 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:04.963387 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:04.964078 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:04.964518 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:04.964935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:04.992946 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Flavor limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:31:04.993364 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Image limits 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:31:04.993881 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Flavor pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:31:04.994288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Image pref 0:0:0 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:31:04.994693 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.virt.hardware [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121310) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:31:05.003499 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:05.003972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:05.004402 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:05.005124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:05.005571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:05.006013 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:05.023029 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Getting quotas for project 52aad667fe8d4b6582a7e4340ecfe33f. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:31:05.026732 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.quota [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Getting quotas for user 8a77b0db996b4bd58f2a92344a26fe78 and project 52aad667fe8d4b6582a7e4340ecfe33f. Resources: {'instances', 'cores', 'ram'} {{(pid=121310) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:31:05.083723 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Going to run 1 instances... {{(pid=121310) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:31:05.085812 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='273fb191-f2b6-4682-ac88-e8a200561927',volume_size=None,volume_type=None)] {{(pid=121310) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:31:05.095397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:05.103941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3056ee0c-3fde-487c-a253-20004ca597d7 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.152981 Aug 25 05:31:05.104455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 571/1135] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:04 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:05.475405 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-119fea0f-c853-4f83-9713-c16ad21061a1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.963333 Aug 25 05:31:05.476065 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 565/1136] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:31:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:31:05.486963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-77d59ff1-4e6f-45ac-bb72-90b0590d1031 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:05.487581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-77d59ff1-4e6f-45ac-bb72-90b0590d1031 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:05.544522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-77d59ff1-4e6f-45ac-bb72-90b0590d1031 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:05.551957 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-77d59ff1-4e6f-45ac-bb72-90b0590d1031 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1088 microversion: 2.1 time: 0.068876 Aug 25 05:31:05.552530 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 572/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:05 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:06.124719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:06.125308 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:06.132479 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:06.132984 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:06.133411 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:06.134134 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:06.134586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:06.135012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:06.272980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:06.280798 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-f51d8c4d-69c2-43b0-b8f0-48ba1190b2de tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.160465 Aug 25 05:31:06.281365 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 566/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:06 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:06.573037 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:06.573681 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:06.581103 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:06.581579 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:06.582242 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:06.582938 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:06.583386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:06.583803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:06.645170 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:06.652895 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-7ff6bd30-1326-4237-af67-07620d7d5a1c tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1138 microversion: 2.1 time: 0.083867 Aug 25 05:31:06.653468 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 573/1139] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:06 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:07.300616 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:07.301260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:07.307679 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:07.318954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:07.318954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:07.318954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:07.318954 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:07.319380 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:07.440492 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:07.448255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b0378f2b-418c-464b-98d3-0d120fc5db86 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.151438 Aug 25 05:31:07.448825 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 567/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:07 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:07.673229 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:07.674036 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:07.681344 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:07.682112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:07.682537 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:07.683231 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:07.683905 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:07.685416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:07.757101 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:07.765126 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1bc90f7d-c560-49ac-88d8-7a60f158b171 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1194 microversion: 2.1 time: 0.095907 Aug 25 05:31:07.765737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 574/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:07 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:07.958236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-17c72bd1-b784-4300-9f4f-a1cd38512a1a req-8e50e664-c97b-4659-abc8-6b8898e1f9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a10724-ad1c-4496-8e15-a75869e1debe", "name": "network-vif-plugged", "status": "completed", "tag": "f9f79aa8-d802-4b1a-89ca-cc34588990e3"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:07.967690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-17c72bd1-b784-4300-9f4f-a1cd38512a1a req-8e50e664-c97b-4659-abc8-6b8898e1f9e9 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:07.968154 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-17c72bd1-b784-4300-9f4f-a1cd38512a1a req-8e50e664-c97b-4659-abc8-6b8898e1f9e9 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:07.968570 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-17c72bd1-b784-4300-9f4f-a1cd38512a1a req-8e50e664-c97b-4659-abc8-6b8898e1f9e9 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:07.980347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-17c72bd1-b784-4300-9f4f-a1cd38512a1a req-8e50e664-c97b-4659-abc8-6b8898e1f9e9 service nova] Creating event network-vif-plugged:f9f79aa8-d802-4b1a-89ca-cc34588990e3 for instance 79a10724-ad1c-4496-8e15-a75869e1debe on hv-cinder-85391 Aug 25 05:31:07.985553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-17c72bd1-b784-4300-9f4f-a1cd38512a1a req-8e50e664-c97b-4659-abc8-6b8898e1f9e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089283 Aug 25 05:31:07.986598 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 568/1142] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:08.475343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:08.475343 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:08.476999 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:08.477994 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:08.478755 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:08.480334 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:08.480932 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:08.481728 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:08.627929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:08.635809 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4effec55-5863-4771-809f-e1b7013d317b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.170692 Aug 25 05:31:08.636398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 575/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:08 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:08.787594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:08.788221 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:08.794290 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:08.801557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:08.801557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:08.801557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:08.801557 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:08.802023 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:08.924866 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:08.932588 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-fa3ec034-420e-4e1f-b027-28b16c2a57a7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1272 microversion: 2.1 time: 0.150668 Aug 25 05:31:08.933144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:08 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:09.656706 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:09.657322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:09.663935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:09.664456 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:09.664847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:09.665538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:09.665947 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-ddccd07e-8c55-4f39-8eb8-2ffc1b311855 req-bc911047-4a46-44c4-8bb0-1fb346ccb576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be489d1a-8da6-4c45-8917-826eab40d642", "tag": "e4f9ade5-936a-44fc-81c2-05d1059b8111"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:09.666100 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:09.666416 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:09.677125 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ddccd07e-8c55-4f39-8eb8-2ffc1b311855 req-bc911047-4a46-44c4-8bb0-1fb346ccb576 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:09.678241 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ddccd07e-8c55-4f39-8eb8-2ffc1b311855 req-bc911047-4a46-44c4-8bb0-1fb346ccb576 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:09.679743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-ddccd07e-8c55-4f39-8eb8-2ffc1b311855 req-bc911047-4a46-44c4-8bb0-1fb346ccb576 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:09.690735 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-ddccd07e-8c55-4f39-8eb8-2ffc1b311855 req-bc911047-4a46-44c4-8bb0-1fb346ccb576 service nova] Creating event network-changed:e4f9ade5-936a-44fc-81c2-05d1059b8111 for instance be489d1a-8da6-4c45-8917-826eab40d642 on hv-cinder-85391 Aug 25 05:31:09.696952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-ddccd07e-8c55-4f39-8eb8-2ffc1b311855 req-bc911047-4a46-44c4-8bb0-1fb346ccb576 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034841 Aug 25 05:31:09.697922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 570/1145] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:31:09.805444 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:09.813254 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ecd252bb-3609-4bfb-92f4-312fb8b001be tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1265 microversion: 2.1 time: 0.160836 Aug 25 05:31:09.813773 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 576/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:09 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:09.954813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:09.955501 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:09.961906 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:09.962380 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:09.962807 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:09.963483 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:09.963922 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:09.964419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:10.094885 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:10.103181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1d8a2975-c9fc-45f8-ad8d-32a29e60c6ac tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1272 microversion: 2.1 time: 0.152876 Aug 25 05:31:10.103742 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 571/1147] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:09 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:10.833842 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:10.834447 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:10.840777 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:10.841254 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:10.841709 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:10.842402 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:10.842853 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:10.843269 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:10.971390 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:10.979331 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5ebae6d4-79bd-41d5-ace7-fa586a46619b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1452 microversion: 2.1 time: 0.149895 Aug 25 05:31:10.979897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 577/1148] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:10 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:11.000796 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:11.001335 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:11.004470 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:11.009090 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:11.009583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:11.010040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:11.010719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:11.011172 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:11.011586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:11.124697 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:11.125307 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:11.131965 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:11.132455 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:11.132885 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:11.133571 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:11.134035 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:11.134459 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:11.142274 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:11.150205 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-00440758-de75-4524-8641-3f489c0169cb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1452 microversion: 2.1 time: 0.153254 Aug 25 05:31:11.151102 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 572/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:10 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:11.282527 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:11.286571 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:11.291181 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-8e83a78c-f044-459f-852c-49fa92827904 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.170923 Aug 25 05:31:11.291761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 578/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:11 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:12.317441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:12.318084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:12.324472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:12.324942 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:12.325368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:12.326090 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:12.326543 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:12.326989 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:12.456980 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:12.464697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-001a60f3-b878-4f88-9253-f454e943a074 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.152211 Aug 25 05:31:12.468465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 573/1151] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:12 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:13.067403 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-d68d5a79-8c6a-48ac-9286-688aef8b8bdc req-df8d23f9-380f-4044-be2d-15e0cc2181c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a10724-ad1c-4496-8e15-a75869e1debe", "tag": "f9f79aa8-d802-4b1a-89ca-cc34588990e3"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:13.077667 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-d68d5a79-8c6a-48ac-9286-688aef8b8bdc req-df8d23f9-380f-4044-be2d-15e0cc2181c3 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:13.078221 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-d68d5a79-8c6a-48ac-9286-688aef8b8bdc req-df8d23f9-380f-4044-be2d-15e0cc2181c3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:13.078719 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-d68d5a79-8c6a-48ac-9286-688aef8b8bdc req-df8d23f9-380f-4044-be2d-15e0cc2181c3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:13.090034 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-d68d5a79-8c6a-48ac-9286-688aef8b8bdc req-df8d23f9-380f-4044-be2d-15e0cc2181c3 service nova] Creating event network-changed:f9f79aa8-d802-4b1a-89ca-cc34588990e3 for instance 79a10724-ad1c-4496-8e15-a75869e1debe on hv-cinder-85391 Aug 25 05:31:13.095773 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-d68d5a79-8c6a-48ac-9286-688aef8b8bdc req-df8d23f9-380f-4044-be2d-15e0cc2181c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032398 Aug 25 05:31:13.096423 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 579/1152] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:13.485739 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:13.486368 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:13.493450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:13.494185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:13.494611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:13.495312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:13.495754 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:13.496164 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:13.500539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=100 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:13.706636 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:13.714547 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-5f1025e5-325a-40c7-9a6f-04f848b70ae2 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.232694 Aug 25 05:31:13.715118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 574/1153] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:13 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:14.736897 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:14.737616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:14.740446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:14.745659 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:14.753321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:14.753321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:14.753321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:14.753321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:14.753739 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:14.883469 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:14.891409 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-60389db3-d779-4bc9-8f2d-03f7c4d1e4c7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.159044 Aug 25 05:31:14.891970 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 580/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:14 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:15.912737 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:15.913341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:15.915663 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=2 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:15.916458 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=6 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:15.921195 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:15.921704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:15.928181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:15.928181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:15.928181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:15.928181 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:16.055878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:16.063537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0ef689c1-5b81-4dfe-8b0e-0f493744cf03 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.155181 Aug 25 05:31:16.064106 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 575/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:15 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:17.084653 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:17.085256 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:17.087149 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:31:17.092261 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:17.092751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:17.093208 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:17.093927 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:17.094368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:17.094785 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:17.225121 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:17.232862 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-aefca0f9-cbd3-4a4f-ac75-d1b1f54fda4e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.152520 Aug 25 05:31:17.234770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 581/1156] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:17 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:18.253326 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:18.253971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:18.260370 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:18.260839 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:18.261260 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:18.261974 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:18.262413 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:18.262826 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:18.396529 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:18.405606 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-a616da93-4752-4274-a46b-e4bf1bd6d295 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.156062 Aug 25 05:31:18.406272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 576/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:18 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:19.430538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:19.431154 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:19.437511 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:19.438010 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:19.438435 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:19.439110 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:19.439553 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:19.439965 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:19.571914 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:19.579560 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-68240009-2a42-4fe4-bc05-6bac2cfc6770 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.152909 Aug 25 05:31:19.580130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 582/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:19 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:31:20.600442 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:20.601075 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:20.607475 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:20.607951 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:20.608378 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:20.609057 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:20.609500 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:20.609953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:20.738001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:20.745900 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4bbbbbbc-5847-429c-a32a-c60e523cd614 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.149595 Aug 25 05:31:20.746623 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 577/1159] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:20 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:21.767206 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:21.767807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:21.774768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:21.775234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:21.775655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:21.776330 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:21.776770 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:21.777187 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:21.912442 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:21.920329 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9d7abd7a-3cc9-415b-bd1a-475cbde6373e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.156961 Aug 25 05:31:21.920894 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 583/1160] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:21 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:21.963169 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-d568c8f0-0e15-4237-86fe-fc20c415d40c req-b54a44a3-9394-454d-8a96-6fc95f97b41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be489d1a-8da6-4c45-8917-826eab40d642", "name": "network-vif-plugged", "status": "completed", "tag": "e4f9ade5-936a-44fc-81c2-05d1059b8111"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:21.973170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d568c8f0-0e15-4237-86fe-fc20c415d40c req-b54a44a3-9394-454d-8a96-6fc95f97b41f service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:21.973657 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d568c8f0-0e15-4237-86fe-fc20c415d40c req-b54a44a3-9394-454d-8a96-6fc95f97b41f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:21.974076 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d568c8f0-0e15-4237-86fe-fc20c415d40c req-b54a44a3-9394-454d-8a96-6fc95f97b41f service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:21.985228 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-d568c8f0-0e15-4237-86fe-fc20c415d40c req-b54a44a3-9394-454d-8a96-6fc95f97b41f service nova] Creating event network-vif-plugged:e4f9ade5-936a-44fc-81c2-05d1059b8111 for instance be489d1a-8da6-4c45-8917-826eab40d642 on hv-cinder-85391 Aug 25 05:31:21.990588 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-d568c8f0-0e15-4237-86fe-fc20c415d40c req-b54a44a3-9394-454d-8a96-6fc95f97b41f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030973 Aug 25 05:31:21.991169 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 578/1161] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:31:22.941024 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:22.941690 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:22.947528 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:22.947993 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:22.948415 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:22.949085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:22.949523 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:22.949955 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:23.076856 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:23.085011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bc797e25-bdb9-451b-b485-d429375df267 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1260 microversion: 2.1 time: 0.147958 Aug 25 05:31:23.085601 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 584/1162] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:22 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:24.106809 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:24.107525 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:24.114182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:24.114650 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:24.115077 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:24.115751 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:24.116195 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:24.116610 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:24.251953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:24.260311 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-ec4fac72-e577-4c0a-a447-9e5a3b88f4c4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1443 microversion: 2.1 time: 0.157706 Aug 25 05:31:24.260872 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 579/1163] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:24 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:24.281082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:31:24.281704 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:31:24.288045 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:24.288522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:24.288933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:24.289633 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:24.290080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:24.290488 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:24.422262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:31:24.430560 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-12a641b4-23d5-4235-a6a9-3ce28fac71c3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1443 microversion: 2.1 time: 0.153389 Aug 25 05:31:24.431125 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 585/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:31:24 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:31:26.519177 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-1443dab9-5c84-4422-b1a3-2d0926abb3ec req-c3316702-5e48-46af-bc7a-0c101b825d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be489d1a-8da6-4c45-8917-826eab40d642", "tag": "e4f9ade5-936a-44fc-81c2-05d1059b8111"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:31:26.528991 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-1443dab9-5c84-4422-b1a3-2d0926abb3ec req-c3316702-5e48-46af-bc7a-0c101b825d3b service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:31:26.529532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-1443dab9-5c84-4422-b1a3-2d0926abb3ec req-c3316702-5e48-46af-bc7a-0c101b825d3b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:31:26.530038 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-1443dab9-5c84-4422-b1a3-2d0926abb3ec req-c3316702-5e48-46af-bc7a-0c101b825d3b service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:31:26.541890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-1443dab9-5c84-4422-b1a3-2d0926abb3ec req-c3316702-5e48-46af-bc7a-0c101b825d3b service nova] Creating event network-changed:e4f9ade5-936a-44fc-81c2-05d1059b8111 for instance be489d1a-8da6-4c45-8917-826eab40d642 on hv-cinder-85391 Aug 25 05:31:26.547300 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-1443dab9-5c84-4422-b1a3-2d0926abb3ec req-c3316702-5e48-46af-bc7a-0c101b825d3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031862 Aug 25 05:31:26.548143 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 580/1165] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:13.918389 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=11 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:13.923535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=38 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:13.923535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 05:33:13.923535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Thu Aug 25 05:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Aug 25 05:33:13.923535 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 25 05:33:13.926447 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1311777110", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1690370930", "security_groups": [{"name": "tempest-secgroup-smoke-680604050"}], "block_device_mapping_v2": [{"uuid": "b2cb6601-4a67-4d32-8f03-3fe729bb1df9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fe1a6d4-dbf8-431a-b133-4fa967b7e77d"}]}} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:14.042865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.network.neutron [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] validate_networks() for [('7fe1a6d4-dbf8-431a-b133-4fa967b7e77d', None, None, None, None, None)] {{(pid=121314) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 05:33:14.472549 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Flavor limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 05:33:14.472963 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Image limits 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 05:33:14.473441 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Flavor pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 05:33:14.473871 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Image pref 0:0:0 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 05:33:14.475086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.virt.hardware [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121314) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 05:33:14.483739 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:14.485630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:14.485630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:14.485630 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:14.485956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:14.486163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:14.503238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 05:33:14.507372 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.quota [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Getting quotas for user 8920a7e7625b46f59c3a89e2930f6535 and project 5223392ed2dc4eff871b9e788e4d677e. Resources: {'instances', 'cores', 'ram'} {{(pid=121314) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 05:33:14.562864 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Going to run 1 instances... {{(pid=121314) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 05:33:14.564948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2cb6601-4a67-4d32-8f03-3fe729bb1df9',volume_size=None,volume_type=None)] {{(pid=121314) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 05:33:15.014616 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-d360ce1a-a109-4688-af5a-0dcaaa1b8ba1 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.097865 Aug 25 05:33:15.015538 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 586/1166] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Aug 25 05:33:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 05:33:15.024613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dad7a83c-d363-4c82-9296-471072b08019] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:33:15.025301 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=17 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:15.026124 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=32 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:15.027508 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 05:33:15.027707 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Thu Aug 25 05:33:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d (ip 10.222.0.16) !!! Aug 25 05:33:15.033214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8f4bc1b6-5c99-4441-8b06-9b2628343433 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:15.033950 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8f4bc1b6-5c99-4441-8b06-9b2628343433 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:15.091841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8f4bc1b6-5c99-4441-8b06-9b2628343433 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:15.098690 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8f4bc1b6-5c99-4441-8b06-9b2628343433 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1095 microversion: 2.1 time: 0.076425 Aug 25 05:33:15.100040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 581/1167] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:15 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:16.119393 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-52cd93d0-35ab-459d-ba7e-c50abc95b136 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:16.120040 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-52cd93d0-35ab-459d-ba7e-c50abc95b136 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:16.172410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-52cd93d0-35ab-459d-ba7e-c50abc95b136 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:16.179209 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-52cd93d0-35ab-459d-ba7e-c50abc95b136 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1095 microversion: 2.1 time: 0.064076 Aug 25 05:33:16.179765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 587/1168] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:16 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:17.199767 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3f09fa82-1d3a-4087-b1f9-fda309014b69 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:17.200754 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3f09fa82-1d3a-4087-b1f9-fda309014b69 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:17.216437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO oslo.messaging._drivers.impl_rabbit [-] [dad7a83c-d363-4c82-9296-471072b08019] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 52942. Aug 25 05:33:17.265165 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3f09fa82-1d3a-4087-b1f9-fda309014b69 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:17.272158 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3f09fa82-1d3a-4087-b1f9-fda309014b69 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1095 microversion: 2.1 time: 0.076674 Aug 25 05:33:17.272720 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 582/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:17 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:18.292977 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-f4e1fa66-33d2-4ec9-bc48-0e910109d011 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:18.293512 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-f4e1fa66-33d2-4ec9-bc48-0e910109d011 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:18.346437 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-f4e1fa66-33d2-4ec9-bc48-0e910109d011 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:18.353386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-f4e1fa66-33d2-4ec9-bc48-0e910109d011 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1095 microversion: 2.1 time: 0.064372 Aug 25 05:33:18.353996 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 588/1170] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:18 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:19.374077 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:19.374673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:19.381933 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:19.382409 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:19.382841 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:19.383530 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:19.383978 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:19.384397 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:19.446961 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:19.455234 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-29a2e0de-b970-4ba2-888b-ca4348370587 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1145 microversion: 2.1 time: 0.085099 Aug 25 05:33:19.455789 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 583/1171] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:19 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:20.476504 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:20.477048 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:20.483548 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:20.486575 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:20.486575 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:20.486575 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:20.486575 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:20.486968 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:20.548146 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:20.555789 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0f0e7f51-d8cc-46ae-9b64-45f72923568b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1193 microversion: 2.1 time: 0.084139 Aug 25 05:33:20.556351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 589/1172] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:20 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:21.576613 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:21.577420 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:21.583600 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:21.586144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:21.586144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:21.586144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:21.586144 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:21.586566 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:21.658153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:21.666269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-82f83b57-64f0-4556-94de-7619c9d0fe9d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1211 microversion: 2.1 time: 0.093678 Aug 25 05:33:21.668389 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 584/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:21 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:22.686799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:22.687440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:22.694043 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:22.694515 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:22.694936 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:22.695606 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:22.696046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:22.696484 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:22.735230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-a495f755-ff13-4da9-a5f5-2f860022b166 req-a954ad27-6363-4836-b152-8bfcaee986e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b514de-3486-4055-b751-ec88b76bb29d", "tag": "06d406da-1bc2-4e2b-9bdd-0a19bdb65c68"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:22.752036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-a495f755-ff13-4da9-a5f5-2f860022b166 req-a954ad27-6363-4836-b152-8bfcaee986e4 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:22.752776 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-a495f755-ff13-4da9-a5f5-2f860022b166 req-a954ad27-6363-4836-b152-8bfcaee986e4 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:22.753382 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-a495f755-ff13-4da9-a5f5-2f860022b166 req-a954ad27-6363-4836-b152-8bfcaee986e4 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:22.767306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-a495f755-ff13-4da9-a5f5-2f860022b166 req-a954ad27-6363-4836-b152-8bfcaee986e4 service nova] Creating event network-changed:06d406da-1bc2-4e2b-9bdd-0a19bdb65c68 for instance 45b514de-3486-4055-b751-ec88b76bb29d on hv-cinder-85391 Aug 25 05:33:22.772550 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-a495f755-ff13-4da9-a5f5-2f860022b166 req-a954ad27-6363-4836-b152-8bfcaee986e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040468 Aug 25 05:33:22.773524 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 585/1174] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:22.851232 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:22.858954 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4b7c51fd-5212-48ec-93c3-4c1a1ce54b1b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.175982 Aug 25 05:33:22.859521 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:22 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:23.881438 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:23.882232 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:23.889042 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:23.889513 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:23.890385 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:23.891093 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:23.891539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:23.891949 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:24.019362 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:24.027586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b72a9b6f-c5da-4215-9da8-0894e012d4ec tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.151004 Aug 25 05:33:24.028153 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 586/1176] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:23 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:25.048321 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:25.048948 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:25.050785 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:25.055483 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:25.055952 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:25.056406 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:25.057080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:25.057522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:25.058003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:25.186234 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:25.193757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-110f82c3-154b-432a-b565-27c4747fa17e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.149456 Aug 25 05:33:25.194314 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 591/1177] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:25 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:26.213827 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:26.214439 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:26.221084 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:26.221566 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:26.222024 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:26.222717 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:26.223170 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:26.223594 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:26.350087 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:26.358127 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b3d1179a-393b-4157-b8a6-094a6ea56b1c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.148202 Aug 25 05:33:26.358687 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 587/1178] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:26 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:27.378454 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:27.379057 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:27.385351 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:27.385847 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:27.386270 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:27.386951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:27.387386 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:27.387795 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:27.519683 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:27.527779 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6cacd046-f1c6-441f-ae08-8ef7b82f9690 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.153125 Aug 25 05:33:27.528347 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 592/1179] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:27 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:28.548116 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:28.548719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:28.551109 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell0:SELECT=4 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:28.555806 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:28.556859 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:28.557288 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:28.557997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:28.558444 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:28.558850 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:28.688011 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:28.695635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3293c57f-c79e-46f2-9e25-b8c57e667e8f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.151326 Aug 25 05:33:28.697633 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 588/1180] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:28 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:29.716132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:29.716812 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:29.718671 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell0:SELECT=10 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:29.723828 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:29.724301 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:29.724985 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:29.725700 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:29.726148 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:29.726567 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:29.855040 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:29.862597 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-553afaae-d4ad-437b-9446-1a7c94898e9b tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.150395 Aug 25 05:33:29.863194 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 593/1181] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:29 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:30.883432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:30.884016 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:30.891098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:30.891571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:30.891999 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:30.892676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:30.893118 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:30.893532 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:31.019416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:31.026997 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-bef3e353-8cd1-4edd-84d7-a2f916e288f5 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.147412 Aug 25 05:33:31.027560 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 589/1182] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:30 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:32.046971 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:32.047569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:32.053945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:32.054413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:32.054837 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:32.055674 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:32.055939 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:32.056350 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:32.186867 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:32.194646 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4f544d19-72d5-4376-9cae-2c94380caedb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.151515 Aug 25 05:33:32.195207 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 594/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:32 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:33.216005 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:33.216611 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:33.223447 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:33.223777 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:33.224213 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:33.225183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:33.225665 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:33.226095 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:33.359725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:33.367408 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7c1cbd14-6271-4fd8-9aea-ab4317dc8d17 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.155725 Aug 25 05:33:33.367970 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 590/1184] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:33 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:34.387757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:34.388388 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:34.394937 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:34.395405 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:34.395829 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:34.396506 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:34.396945 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:34.397356 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:34.524665 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:34.532519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-312cc1b8-48bc-4b88-bcb0-7e08d9235e57 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.148673 Aug 25 05:33:34.533085 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 595/1185] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:34 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:33:34.760183 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-4f210428-5e90-4785-8070-2d8b518a3c8a req-2e8cb21c-657d-4f80-a88a-78ab7f4892c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b514de-3486-4055-b751-ec88b76bb29d", "name": "network-vif-plugged", "status": "completed", "tag": "06d406da-1bc2-4e2b-9bdd-0a19bdb65c68"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:34.770217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4f210428-5e90-4785-8070-2d8b518a3c8a req-2e8cb21c-657d-4f80-a88a-78ab7f4892c1 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:34.770685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4f210428-5e90-4785-8070-2d8b518a3c8a req-2e8cb21c-657d-4f80-a88a-78ab7f4892c1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:34.771105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-4f210428-5e90-4785-8070-2d8b518a3c8a req-2e8cb21c-657d-4f80-a88a-78ab7f4892c1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:34.782289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-4f210428-5e90-4785-8070-2d8b518a3c8a req-2e8cb21c-657d-4f80-a88a-78ab7f4892c1 service nova] Creating event network-vif-plugged:06d406da-1bc2-4e2b-9bdd-0a19bdb65c68 for instance 45b514de-3486-4055-b751-ec88b76bb29d on hv-cinder-85391 Aug 25 05:33:34.787312 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-4f210428-5e90-4785-8070-2d8b518a3c8a req-2e8cb21c-657d-4f80-a88a-78ab7f4892c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030984 Aug 25 05:33:34.788080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 591/1186] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:33:35.553391 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:35.553962 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:35.560318 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:35.560786 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:35.561210 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:35.561918 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:35.562358 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:35.562771 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:35.689865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:35.697811 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5cf3495b-fa21-4421-b688-977a03756f9c tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.148372 Aug 25 05:33:35.698376 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 596/1187] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:35 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:36.719315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:36.720040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:36.726644 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:36.727136 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:36.727573 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:36.729389 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:36.729878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:36.730307 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:36.866347 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:36.874615 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-cc6ea74c-29a1-4317-87ed-93e248f40699 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1266 microversion: 2.1 time: 0.160057 Aug 25 05:33:36.875184 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 592/1188] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:36 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:37.894799 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:37.895422 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:37.902520 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:37.903002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:37.903458 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:37.904157 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:37.904608 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:37.905030 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:38.043724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:38.046712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-c2406566-a34d-405a-a080-f5387ad1ca56 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1453 microversion: 2.1 time: 0.155783 Aug 25 05:33:38.047283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 597/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:37 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:38.066249 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:38.066857 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:38.074272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:38.074853 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:38.075417 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:38.076150 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:38.076644 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:38.077174 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:38.206542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:38.214861 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-d292d79a-767f-4bc9-96d9-63c11a31b68e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1453 microversion: 2.1 time: 0.152404 Aug 25 05:33:38.215416 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 593/1190] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:38 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:40.399543 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-a7b9e1f5-8124-4e50-a1b2-41bb8f314bb6 req-b3c0c108-2c11-410f-a0a5-fabc032deb32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b514de-3486-4055-b751-ec88b76bb29d", "tag": "06d406da-1bc2-4e2b-9bdd-0a19bdb65c68"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:40.409597 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a7b9e1f5-8124-4e50-a1b2-41bb8f314bb6 req-b3c0c108-2c11-410f-a0a5-fabc032deb32 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:40.410192 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a7b9e1f5-8124-4e50-a1b2-41bb8f314bb6 req-b3c0c108-2c11-410f-a0a5-fabc032deb32 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:40.410685 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-a7b9e1f5-8124-4e50-a1b2-41bb8f314bb6 req-b3c0c108-2c11-410f-a0a5-fabc032deb32 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:40.422400 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-a7b9e1f5-8124-4e50-a1b2-41bb8f314bb6 req-b3c0c108-2c11-410f-a0a5-fabc032deb32 service nova] Creating event network-changed:06d406da-1bc2-4e2b-9bdd-0a19bdb65c68 for instance 45b514de-3486-4055-b751-ec88b76bb29d on hv-cinder-85391 Aug 25 05:33:40.427476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-a7b9e1f5-8124-4e50-a1b2-41bb8f314bb6 req-b3c0c108-2c11-410f-a0a5-fabc032deb32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031739 Aug 25 05:33:40.428091 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 598/1191] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:33:42.230002 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:42.230539 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:42.236976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:42.237449 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:42.237914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:42.238599 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:42.239040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:42.239460 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:42.262341 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lazy-loading 'flavor' on Instance uuid be489d1a-8da6-4c45-8917-826eab40d642 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:33:42.584697 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-24ee06e6-ddec-4b17-ab84-0a889df2b3c5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "POST /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642/action" status: 202 len: 0 microversion: 2.1 time: 0.358230 Aug 25 05:33:42.585160 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 594/1192] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:33:42 2022] POST /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:42.595760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:42.596450 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:42.603838 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:42.604314 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:42.604741 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:42.605459 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:42.605935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:42.606354 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:42.739557 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:42.748002 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-72dec22e-0a14-4816-b421-c0c4bb8b6a2e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.157095 Aug 25 05:33:42.748561 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 599/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:42 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:43.769371 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:43.770120 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:43.776195 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:43.776669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:43.777099 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:43.777811 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:43.778255 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:43.778669 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:43.909379 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:43.917387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-3df58795-b084-46b8-b095-f6ce4a38ea22 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.152725 Aug 25 05:33:43.917986 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 595/1194] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:43 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:44.939427 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:44.940053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:44.942428 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:44.947874 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:44.948342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:44.948760 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:44.949431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:44.949937 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:44.953737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:44.953737 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=65 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:45.083811 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:45.092069 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-61321dd0-3e0c-48cd-b21a-f8dc43131bec tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.156527 Aug 25 05:33:45.092631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 600/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:44 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:46.113105 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:46.113709 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:46.116097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=35 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:46.120748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:46.121216 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:46.121665 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:46.122344 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:46.122781 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:46.123240 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:46.250142 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:46.257847 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-695625c8-d572-40cd-b7a2-3a47a3348fd6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.148540 Aug 25 05:33:46.258647 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 596/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:46 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:47.279602 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:47.280215 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:47.286688 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:47.287163 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:47.287589 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:47.288271 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:47.288713 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:47.289123 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:47.417508 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:47.425214 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-ef136783-3abb-45ad-adfa-a9aed558d993 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.149520 Aug 25 05:33:47.425807 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 601/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:47 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:48.446132 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:48.447306 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:48.453400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:48.453908 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:48.454330 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:48.455000 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:48.455437 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:48.455844 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:48.458390 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:33:48.586519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:48.594083 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-0534957a-7f4c-470c-bbfa-bb6e317f6252 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.151936 Aug 25 05:33:48.594652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 597/1198] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:48 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:49.616297 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:49.616849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:49.627588 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:49.628067 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:49.628498 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:49.629184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:49.629656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:49.630077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:49.757080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:49.764924 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-0a784afd-a5f9-4c91-baf6-e9909cf99ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.152589 Aug 25 05:33:49.765489 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 602/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:49 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:50.786419 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:50.787021 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:50.793924 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:50.794393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:50.794816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:50.795488 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:50.795929 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:50.796343 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:50.923972 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:50.932367 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-802b0d40-3f07-4624-a8b2-d4538b1726d0 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.149836 Aug 25 05:33:50.932927 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 598/1200] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:50 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:51.954337 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:51.954935 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:51.961941 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:51.962421 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:51.962850 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:51.963542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:51.963995 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:51.964413 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:52.093522 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:52.101610 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-06ef960b-d868-47ce-be8d-cc342856b791 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.151810 Aug 25 05:33:52.102185 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 603/1201] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:51 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:53.123182 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:53.123788 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:53.130472 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:53.130939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:53.131359 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:53.132036 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:53.132513 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:53.132931 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:53.364540 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:53.373542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6f801690-04e5-4ca0-a8e9-fab756a57e58 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.254853 Aug 25 05:33:53.374631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 599/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:53 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:54.395225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:54.395858 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:54.402265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:54.402758 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:54.403179 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:54.403849 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:54.404287 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:54.404699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:54.538247 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:54.545854 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-cca7aa87-25a0-470c-b43e-c39c5d947cd9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.154544 Aug 25 05:33:54.546421 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 604/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:54 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:55.568210 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:55.568890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:55.575292 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:55.575761 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:55.576184 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:55.576870 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:55.577305 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:55.577744 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:55.705393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:55.713793 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e3ee3e8e-b312-40fe-bacd-22adc2f669f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.149435 Aug 25 05:33:55.718556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 600/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:55 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:56.735545 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:56.736112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:56.742495 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:56.742971 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:56.743397 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:56.744724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:56.745168 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:56.745599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:56.963081 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:56.971265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-205c4dad-3b5d-4303-9e25-2ab98fa0915b tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1568 microversion: 2.1 time: 0.239680 Aug 25 05:33:56.971837 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 605/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:56 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:56.992185 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:33:56.992738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:56.999958 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:57.000426 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:57.000852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:57.001572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:57.002035 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:57.003303 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:57.089551 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121310) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 05:33:57.382107 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [212d11e8-5683-4d75-a9e1-537b6be5648e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 25 05:33:58.388843 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [212d11e8-5683-4d75-a9e1-537b6be5648e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53048. Aug 25 05:33:58.392469 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-1b046f57-20eb-484d-b483-c1064262b3e1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "POST /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642/action" status: 202 len: 0 microversion: 2.1 time: 1.404286 Aug 25 05:33:58.393089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 601/1206] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Aug 25 05:33:56 2022] POST /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642/action => generated 0 bytes in 1405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:33:58.401076 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:58.401826 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:58.408602 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:58.409079 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:58.409505 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:58.410412 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:58.410887 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:58.411304 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:58.542226 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:58.550652 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-91131ee0-be9e-47bd-95e1-8f3dcc6fb7fc tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1516 microversion: 2.1 time: 0.153450 Aug 25 05:33:58.551218 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:58 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:33:59.573245 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:33:59.574012 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:33:59.579763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:59.580237 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:59.580659 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:59.581337 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:33:59.581813 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:33:59.582230 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:33:59.758077 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:33:59.765860 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c312998c-2850-4aba-966a-264353552ee5 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1518 microversion: 2.1 time: 0.197476 Aug 25 05:33:59.766436 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 602/1208] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:33:59 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:00.784794 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-2e55c421-c179-4701-aa01-9e37cbcc601a req-53295d9d-cc1f-4abb-b12d-31a290096de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be489d1a-8da6-4c45-8917-826eab40d642", "name": "network-vif-unplugged", "status": "completed", "tag": "e4f9ade5-936a-44fc-81c2-05d1059b8111"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:00.787358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:00.788704 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:00.795988 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:00.796173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-2e55c421-c179-4701-aa01-9e37cbcc601a req-53295d9d-cc1f-4abb-b12d-31a290096de9 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:00.796645 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-2e55c421-c179-4701-aa01-9e37cbcc601a req-53295d9d-cc1f-4abb-b12d-31a290096de9 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:00.797010 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:00.797138 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-2e55c421-c179-4701-aa01-9e37cbcc601a req-53295d9d-cc1f-4abb-b12d-31a290096de9 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:00.797673 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:00.798619 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:00.799175 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:00.799703 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:00.808398 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.compute.server_external_events [req-2e55c421-c179-4701-aa01-9e37cbcc601a req-53295d9d-cc1f-4abb-b12d-31a290096de9 service nova] Unable to find a host for instance be489d1a-8da6-4c45-8917-826eab40d642. Dropping event network-vif-unplugged {{(pid=121314) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 05:34:00.809272 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-2e55c421-c179-4701-aa01-9e37cbcc601a req-53295d9d-cc1f-4abb-b12d-31a290096de9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028643 Aug 25 05:34:00.809888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 607/1209] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 05:34:00.937656 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:00.944285 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-13f3813f-21ca-4c88-8b4d-e9eef429b4c1 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1518 microversion: 2.1 time: 0.161039 Aug 25 05:34:00.944860 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 603/1210] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:00 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:01.966467 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:01.967084 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:01.973878 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:01.974865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:01.975080 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:01.975761 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:01.976239 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:01.976655 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:02.107249 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:02.114925 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-3b5cf40a-4154-43be-bce4-f92d54f1897a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.153034 Aug 25 05:34:02.115525 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 608/1211] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:01 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:03.136146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:03.136748 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:03.143142 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:03.143610 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:03.144027 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:03.144706 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:03.145145 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:03.145559 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:03.275878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:03.283521 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c080892a-b07b-4bee-a4f9-e9d456640cae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.151263 Aug 25 05:34:03.284080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 604/1212] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:03 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:04.304132 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:04.304739 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:04.311720 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:04.312193 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:04.312622 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:04.313303 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:04.313778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:04.314205 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:04.442225 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:04.449928 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-1d9d8d11-6534-443f-bfc4-fbb49ec39f53 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.149622 Aug 25 05:34:04.450494 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 609/1213] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:04 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:05.471448 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:05.472075 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:05.478744 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:05.479157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:05.479579 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:05.480252 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:05.480688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:05.481097 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:05.610652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:05.618205 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7514b0c4-493f-421a-8fe6-f7a3939111a8 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.150639 Aug 25 05:34:05.619301 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 605/1214] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:05 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 05:34:06.640287 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:06.640888 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:06.647262 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:06.647731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:06.648153 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:06.648828 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:06.649267 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:06.649792 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:06.777894 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:06.785477 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-279362b8-d818-4abf-90b8-6c648d2fb794 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.149064 Aug 25 05:34:06.786065 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 610/1215] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:06 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:07.806396 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:07.807001 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:07.813466 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:07.813971 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:07.814400 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:07.815080 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:07.815526 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:07.815953 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:07.944727 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:07.952362 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-6ca02666-d3de-4628-859a-80bedef5efca tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.149889 Aug 25 05:34:07.952919 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 606/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:07 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:08.973930 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:08.977311 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:08.981657 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:08.982130 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:08.982555 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:08.983238 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:08.983676 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:08.984087 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:09.119399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:09.127184 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-2b38e590-da90-4925-922e-8c81b487a6f3 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.157089 Aug 25 05:34:09.127751 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 611/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:08 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:10.147586 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:10.148225 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:10.154631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:10.156640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:10.156640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:10.156640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:10.156640 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:10.157013 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:10.285063 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:10.293250 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-42200395-4a1a-4ee9-82e1-5244e66e350a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.149549 Aug 25 05:34:10.293889 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 607/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:10 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:11.314640 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:11.315250 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:11.322112 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:11.322580 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:11.323003 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:11.323670 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:11.324109 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:11.324519 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:11.456031 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:11.463894 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5d61873d-2e24-486b-ad42-08de12df5eb7 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.153121 Aug 25 05:34:11.464456 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 612/1219] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:11 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:12.485040 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:12.485563 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:12.491975 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:12.492451 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:12.492878 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:12.494200 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:12.494694 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:12.495125 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:12.626571 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:12.634254 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-c3b92431-904e-4b79-85a2-d9c8826d4a02 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.153503 Aug 25 05:34:12.634819 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 608/1220] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:12 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:12.830621 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-b649c483-9f28-4081-8a07-2771bc6bb2f4 req-dc9f9ee4-f6ce-435d-bad2-25d6e3530238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be489d1a-8da6-4c45-8917-826eab40d642", "name": "network-vif-plugged", "status": "completed", "tag": "e4f9ade5-936a-44fc-81c2-05d1059b8111"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:34:12.840778 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b649c483-9f28-4081-8a07-2771bc6bb2f4 req-dc9f9ee4-f6ce-435d-bad2-25d6e3530238 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:12.841252 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b649c483-9f28-4081-8a07-2771bc6bb2f4 req-dc9f9ee4-f6ce-435d-bad2-25d6e3530238 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:12.841712 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-b649c483-9f28-4081-8a07-2771bc6bb2f4 req-dc9f9ee4-f6ce-435d-bad2-25d6e3530238 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:12.853280 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-b649c483-9f28-4081-8a07-2771bc6bb2f4 req-dc9f9ee4-f6ce-435d-bad2-25d6e3530238 service nova] Creating event network-vif-plugged:e4f9ade5-936a-44fc-81c2-05d1059b8111 for instance be489d1a-8da6-4c45-8917-826eab40d642 on hv-cinder-85391 Aug 25 05:34:12.859765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-b649c483-9f28-4081-8a07-2771bc6bb2f4 req-dc9f9ee4-f6ce-435d-bad2-25d6e3530238 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031737 Aug 25 05:34:12.859765 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 613/1221] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:34:13.654459 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:13.655061 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:13.661415 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:13.661915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:13.662342 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:13.663014 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:13.663457 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:13.663871 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:13.797015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:13.804635 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-873e25e5-c901-4b9b-9630-128a307b3ecd tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.154042 Aug 25 05:34:13.805207 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 609/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:13 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:14.826264 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:14.826957 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:14.833458 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:14.833956 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:14.834377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:14.835046 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:14.835486 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:14.835890 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:14.967089 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:14.975446 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-eb572555-0808-4b66-b58c-1e70b2e8d047 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1574 microversion: 2.1 time: 0.152797 Aug 25 05:34:14.976027 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 614/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:14 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:34:15.997269 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:34:15.997885 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:34:16.004432 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:16.004896 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:16.005316 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:16.006022 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:34:16.006460 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:34:16.006875 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:34:16.133214 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:34:16.141360 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-724fda5e-64ee-4642-bdb2-97c49e32c1c6 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1561 microversion: 2.1 time: 0.148545 Aug 25 05:34:16.141969 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 610/1224] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:34:15 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:30.584757 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a05f4e2a-2cfd-40f2-8386-6fc662ac4fb1] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 05:35:30.587852 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:35:30.588957 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:35:30.598077 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:30.598568 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:30.604911 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_api:SELECT=29 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:35:30.605617 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=81 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:35:30.613322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 05:35:30.613322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Thu Aug 25 05:35:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d (ip 10.222.0.16) !!! Aug 25 05:35:30.613322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:30.613322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:30.613322 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:30.614731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:30.614731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:30.614731 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:30.645926 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:35:30.651497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-d571c8ca-9784-4490-973c-8d9525e41fd2 req-92908701-3b53-4c98-8913-9c12c6fa75e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b514de-3486-4055-b751-ec88b76bb29d", "tag": "06d406da-1bc2-4e2b-9bdd-0a19bdb65c68"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:30.661146 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d571c8ca-9784-4490-973c-8d9525e41fd2 req-92908701-3b53-4c98-8913-9c12c6fa75e4 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:30.661634 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d571c8ca-9784-4490-973c-8d9525e41fd2 req-92908701-3b53-4c98-8913-9c12c6fa75e4 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:30.662148 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-d571c8ca-9784-4490-973c-8d9525e41fd2 req-92908701-3b53-4c98-8913-9c12c6fa75e4 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:30.674189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-d571c8ca-9784-4490-973c-8d9525e41fd2 req-92908701-3b53-4c98-8913-9c12c6fa75e4 service nova] Creating event network-changed:06d406da-1bc2-4e2b-9bdd-0a19bdb65c68 for instance 45b514de-3486-4055-b751-ec88b76bb29d on hv-cinder-85391 Aug 25 05:35:30.680098 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-d571c8ca-9784-4490-973c-8d9525e41fd2 req-92908701-3b53-4c98-8913-9c12c6fa75e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093658 Aug 25 05:35:30.680894 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 611/1225] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:35:30.883876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6a325c6f-2822-4093-8b38-4cf3eb979f4e tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 204 len: 0 microversion: 2.1 time: 0.301002 Aug 25 05:35:30.885209 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 615/1226] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:35:30 2022] DELETE /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 05:35:30.893538 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:30.894369 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:30.902264 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:30.902738 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:30.903284 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:30.904102 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:30.904728 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:30.905315 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:31.039671 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:31.047938 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-4bd70f5e-f699-402e-8b60-4ebbd3bd5146 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1577 microversion: 2.1 time: 0.158494 Aug 25 05:35:31.048505 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 612/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:30 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:32.070380 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:32.071082 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:32.078865 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:32.079330 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:32.079754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:32.080431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:32.080876 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:32.081293 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:32.086775 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO oslo.messaging._drivers.impl_rabbit [-] [a05f4e2a-2cfd-40f2-8386-6fc662ac4fb1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 53146. Aug 25 05:35:32.213083 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:32.220919 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-5e4a30f8-1cc6-4289-9c6f-4948c7c35241 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1577 microversion: 2.1 time: 0.154757 Aug 25 05:35:32.221798 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 616/1228] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:32 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:33.243217 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:33.243843 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:33.250358 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:33.250890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:33.251321 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:33.252015 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:33.252465 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:33.252882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:33.280828 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [req-dd4bb619-08da-4703-bdde-d51299ecefa1 req-b644089f-a261-474a-a461-ef85a78e98b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b514de-3486-4055-b751-ec88b76bb29d", "name": "network-vif-deleted", "tag": "06d406da-1bc2-4e2b-9bdd-0a19bdb65c68"}]} {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:33.290476 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-dd4bb619-08da-4703-bdde-d51299ecefa1 req-b644089f-a261-474a-a461-ef85a78e98b3 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:33.290946 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-dd4bb619-08da-4703-bdde-d51299ecefa1 req-b644089f-a261-474a-a461-ef85a78e98b3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:33.291368 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [req-dd4bb619-08da-4703-bdde-d51299ecefa1 req-b644089f-a261-474a-a461-ef85a78e98b3 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:33.302504 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.compute.server_external_events [req-dd4bb619-08da-4703-bdde-d51299ecefa1 req-b644089f-a261-474a-a461-ef85a78e98b3 service nova] Creating event network-vif-deleted:06d406da-1bc2-4e2b-9bdd-0a19bdb65c68 for instance 45b514de-3486-4055-b751-ec88b76bb29d on hv-cinder-85391 Aug 25 05:35:33.308079 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [req-dd4bb619-08da-4703-bdde-d51299ecefa1 req-b644089f-a261-474a-a461-ef85a78e98b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030861 Aug 25 05:35:33.308677 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 617/1229] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:35:33.327536 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:33.335441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-8a2d6eb6-0413-4543-bc80-eda1273941a0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1392 microversion: 2.1 time: 0.096692 Aug 25 05:35:33.336911 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 613/1230] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:33 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1392 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:34.357399 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:34.358111 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:34.364459 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:34.364929 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:34.365352 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:34.366071 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:34.366835 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:34.367491 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:34.401379 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:34.401883 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:34.402311 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:34.402748 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.objects.instance [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lazy-loading 'fault' on Instance uuid 45b514de-3486-4055-b751-ec88b76bb29d {{(pid=121314) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:35:34.442754 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:34.454497 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9e5f1bf7-c3ed-461e-948b-c562ac46cb7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 200 len: 1231 microversion: 2.1 time: 0.101787 Aug 25 05:35:34.455055 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 618/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:34 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:35.478766 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:35.479310 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 45b514de-3486-4055-b751-ec88b76bb29d] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:35.485752 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:35.486222 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:35.486652 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:35.487338 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:35.487782 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:35.488196 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:35.501393 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] HTTP exception thrown: Instance 45b514de-3486-4055-b751-ec88b76bb29d could not be found. Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Request method failure captured: Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d HTTP/1.1 Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwhCrEl0jI2vyzjiDUgYCAPhrOT7wAsBelgK4a1E2C673fM35DbKRXAYyh--AesNKSWr8WRmgUpq77rfSvm4TW3M-5Tr-mNnJ7qgDT4cnYMAZG4R5ZEfwWY3YSiJSpT1dT_Gz59gDERXhO6ZDm9Br4VrmIL2VmiazEKZV7H0E3jkcH8 Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:35:35.503034 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5223392ed2dc4eff871b9e788e4d677e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 8920a7e7625b46f59c3a89e2930f6535 Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 45b514de-3486-4055-b751-ec88b76bb29d could not be found. Aug 25 05:35:35.504939 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '45b514de-3486-4055-b751-ec88b76bb29d'} Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b514de-3486-4055-b751-ec88b76bb29d could not be found. Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:35:35.506112 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b514de-3486-4055-b751-ec88b76bb29d could not be found. Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b514de-3486-4055-b751-ec88b76bb29d could not be found. Aug 25 05:35:35.507891 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:35.509394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Returning 404 to user: Instance 45b514de-3486-4055-b751-ec88b76bb29d could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:35:35.509394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-7a9435f9-2d46-4171-8667-e18c5e647e7a tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d" status: 404 len: 111 microversion: 2.1 time: 0.030698 Aug 25 05:35:35.509394 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:35 2022] GET /compute/v2.1/servers/45b514de-3486-4055-b751-ec88b76bb29d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:35:38.809365 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:38.810102 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:38.811587 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-69d25374-3d2f-43fd-bef2-8fe100fcf42a req-a3828531-f272-4937-a468-3112392e97d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a10724-ad1c-4496-8e15-a75869e1debe", "tag": "f9f79aa8-d802-4b1a-89ca-cc34588990e3"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:38.816447 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:38.817007 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:38.817543 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:38.818342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:38.818861 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:38.820039 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:38.822474 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-69d25374-3d2f-43fd-bef2-8fe100fcf42a req-a3828531-f272-4937-a468-3112392e97d1 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:38.822936 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-69d25374-3d2f-43fd-bef2-8fe100fcf42a req-a3828531-f272-4937-a468-3112392e97d1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:38.823743 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-69d25374-3d2f-43fd-bef2-8fe100fcf42a req-a3828531-f272-4937-a468-3112392e97d1 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:38.835952 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-69d25374-3d2f-43fd-bef2-8fe100fcf42a req-a3828531-f272-4937-a468-3112392e97d1 service nova] Creating event network-changed:f9f79aa8-d802-4b1a-89ca-cc34588990e3 for instance 79a10724-ad1c-4496-8e15-a75869e1debe on hv-cinder-85391 Aug 25 05:35:38.842094 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-69d25374-3d2f-43fd-bef2-8fe100fcf42a req-a3828531-f272-4937-a468-3112392e97d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034017 Aug 25 05:35:38.842915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 615/1233] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 05:35:38.847286 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:35:39.183015 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-4193637b-979e-4565-a1a7-5603a44097f0 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 204 len: 0 microversion: 2.1 time: 0.377031 Aug 25 05:35:39.183877 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 619/1234] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:35:38 2022] DELETE /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 05:35:39.192481 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:39.193206 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:39.199603 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:39.200823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:39.200823 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:39.201392 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:39.204497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:39.204497 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:39.367745 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:39.375561 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-46d3e717-e6d3-4056-ab55-1a0547e7b66d tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1576 microversion: 2.1 time: 0.187220 Aug 25 05:35:39.376137 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 616/1235] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:39 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:40.396891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:40.397628 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:40.404053 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:40.404526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:40.404951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:40.405656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:40.406213 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:40.406631 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:40.538933 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:40.546658 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-58fbda40-4eda-4732-b17f-f6b6dc02f398 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1576 microversion: 2.1 time: 0.154096 Aug 25 05:35:40.547223 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 620/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:40 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:41.434915 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-55454d3c-8506-46f2-bec6-3d11202580e6 req-ba16e530-0062-4062-96d4-8031634a0580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a10724-ad1c-4496-8e15-a75869e1debe", "name": "network-vif-deleted", "tag": "f9f79aa8-d802-4b1a-89ca-cc34588990e3"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:41.445089 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-55454d3c-8506-46f2-bec6-3d11202580e6 req-ba16e530-0062-4062-96d4-8031634a0580 service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:41.445553 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-55454d3c-8506-46f2-bec6-3d11202580e6 req-ba16e530-0062-4062-96d4-8031634a0580 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:41.446253 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-55454d3c-8506-46f2-bec6-3d11202580e6 req-ba16e530-0062-4062-96d4-8031634a0580 service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:41.456641 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-55454d3c-8506-46f2-bec6-3d11202580e6 req-ba16e530-0062-4062-96d4-8031634a0580 service nova] Creating event network-vif-deleted:f9f79aa8-d802-4b1a-89ca-cc34588990e3 for instance 79a10724-ad1c-4496-8e15-a75869e1debe on hv-cinder-85391 Aug 25 05:35:41.461583 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-55454d3c-8506-46f2-bec6-3d11202580e6 req-ba16e530-0062-4062-96d4-8031634a0580 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Aug 25 05:35:41.462189 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 617/1237] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:35:41.567840 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:41.568440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:41.575940 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:41.576656 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:41.577162 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:41.577874 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:41.578472 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:41.578891 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:41.642526 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8920a7e7625b46f59c3a89e2930f6535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5223392ed2dc4eff871b9e788e4d677e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:41.650283 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-89e6c44b-2754-4f54-ba1a-53870a06b96f tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 200 len: 1225 microversion: 2.1 time: 0.086464 Aug 25 05:35:41.650803 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 621/1238] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:41 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:42.671987 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:42.672688 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 79a10724-ad1c-4496-8e15-a75869e1debe] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:42.678808 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:42.679289 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:42.679725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:42.680439 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:42.680890 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:42.681313 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:42.694302 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] HTTP exception thrown: Instance 79a10724-ad1c-4496-8e15-a75869e1debe could not be found. Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Request method failure captured: Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe HTTP/1.1 Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwhCrEl0jI2vyzjiDUgYCAPhrOT7wAsBelgK4a1E2C673fM35DbKRXAYyh--AesNKSWr8WRmgUpq77rfSvm4TW3M-5Tr-mNnJ7qgDT4cnYMAZG4R5ZEfwWY3YSiJSpT1dT_Gz59gDERXhO6ZDm9Br4VrmIL2VmiazEKZV7H0E3jkcH8 Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:35:42.697983 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5223392ed2dc4eff871b9e788e4d677e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 8920a7e7625b46f59c3a89e2930f6535 Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 79a10724-ad1c-4496-8e15-a75869e1debe could not be found. Aug 25 05:35:42.699542 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '79a10724-ad1c-4496-8e15-a75869e1debe'} Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a10724-ad1c-4496-8e15-a75869e1debe could not be found. Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:35:42.700719 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a10724-ad1c-4496-8e15-a75869e1debe could not be found. Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a10724-ad1c-4496-8e15-a75869e1debe could not be found. Aug 25 05:35:42.702236 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:42.704157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Returning 404 to user: Instance 79a10724-ad1c-4496-8e15-a75869e1debe could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:35:42.704157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-b23c0d36-a3ed-4fd4-8de1-659d822d4beb tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe" status: 404 len: 111 microversion: 2.1 time: 0.030501 Aug 25 05:35:42.704157 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 618/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:42 2022] GET /compute/v2.1/servers/79a10724-ad1c-4496-8e15-a75869e1debe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:35:43.183981 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:43.189299 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:43.191086 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:43.191575 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:43.192011 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:43.192701 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:43.193152 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:43.193569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:43.207377 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] HTTP exception thrown: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Request method failure captured: Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: DELETE /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee HTTP/1.1 Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwhCrEl0jI2vyzjiDUgYCAPhrOT7wAsBelgK4a1E2C673fM35DbKRXAYyh--AesNKSWr8WRmgUpq77rfSvm4TW3M-5Tr-mNnJ7qgDT4cnYMAZG4R5ZEfwWY3YSiJSpT1dT_Gz59gDERXhO6ZDm9Br4VrmIL2VmiazEKZV7H0E3jkcH8 Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:35:43.209008 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5223392ed2dc4eff871b9e788e4d677e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 8920a7e7625b46f59c3a89e2930f6535 Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.210707 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': '285ea616-3317-47c3-9f8f-3ed6bc48b5ee'} Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:35:43.211680 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.213296 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.215172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Returning 404 to user: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:35:43.215172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-9952e281-f78b-4ff4-8fe6-f0dd027c8946 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "DELETE /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 404 len: 111 microversion: 2.1 time: 0.031256 Aug 25 05:35:43.215172 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 622/1240] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:35:43 2022] DELETE /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:35:43.219139 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:43.219901 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] [instance: 285ea616-3317-47c3-9f8f-3ed6bc48b5ee] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:43.226218 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:43.227391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:43.227818 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:43.228515 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:43.228968 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:43.229387 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:43.243578 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.wsgi [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] HTTP exception thrown: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Request method failure captured: Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: request: GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee HTTP/1.1 Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept: application/json Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Accept-Encoding: identity Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Connection: close Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Length: 0 Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Content-Type: application/json Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Host: 10.222.0.16 Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: Openstack-System-Scope: None Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: User-Agent: python-urllib3/1.26.11 Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Auth-Token: gAAAAABjBwhCrEl0jI2vyzjiDUgYCAPhrOT7wAsBelgK4a1E2C673fM35DbKRXAYyh--AesNKSWr8WRmgUpq77rfSvm4TW3M-5Tr-mNnJ7qgDT4cnYMAZG4R5ZEfwWY3YSiJSpT1dT_Gz59gDERXhO6ZDm9Br4VrmIL2VmiazEKZV7H0E3jkcH8 Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Id: None Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Domain-Name: None Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Identity-Status: Confirmed Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Is-Admin-Project: True Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Id: default Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Domain-Name: Default Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Project-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Role: member,reader Aug 25 05:35:43.245101 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Roles: member,reader Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5223392ed2dc4eff871b9e788e4d677e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5223392ed2dc4eff871b9e788e4d677e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Id: 5223392ed2dc4eff871b9e788e4d677e Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-Tenant-Name: tempest-TestVolumeBootPattern-658762128 Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Id: default Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Domain-Name: Default Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Id: 8920a7e7625b46f59c3a89e2930f6535 Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: X-User-Name: tempest-TestVolumeBootPattern-658762128-project Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: method: > Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: exception: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.246836 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: action_args: {'id': '285ea616-3317-47c3-9f8f-3ed6bc48b5ee'} Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:35:43.247982 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. Aug 25 05:35:43.249572 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: ERROR nova.api.openstack.wsgi Aug 25 05:35:43.252167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Returning 404 to user: Instance 285ea616-3317-47c3-9f8f-3ed6bc48b5ee could not be found. {{(pid=121310) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:35:43.252167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-686de4f0-4152-4450-b8cb-fb552351d998 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee" status: 404 len: 111 microversion: 2.1 time: 0.031379 Aug 25 05:35:43.252167 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 619/1241] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:43 2022] GET /compute/v2.1/servers/285ea616-3317-47c3-9f8f-3ed6bc48b5ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 05:35:44.720699 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-bd32bedd-93f5-4772-8548-b77b6f148566 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] Calling method '.version_select at 0x7f2423fa60d0>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:44.814599 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-bd32bedd-93f5-4772-8548-b77b6f148566 tempest-TestVolumeBootPattern-658762128 tempest-TestVolumeBootPattern-658762128-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1690370930" status: 202 len: 0 microversion: 2.1 time: 0.097735 Aug 25 05:35:44.815181 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 623/1242] 10.222.0.16 () {58 vars in 1263 bytes} [Thu Aug 25 05:35:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1690370930 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 05:35:53.600450 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_api:SELECT=18 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:35:53.601179 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG dbcounter [-] [121310] Writing DB stats nova_cell1:SELECT=30 {{(pid=121310) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:35:53.602093 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:53.602596 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:53.618433 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG dbcounter [-] [121314] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121314) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 05:35:53.624113 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:53.624600 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:53.625033 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:53.625782 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:53.626590 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:53.626768 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:53.654263 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Going to try to terminate instance {{(pid=121314) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 05:35:53.823914 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-e082432f-9c78-4393-8088-55370bb94cc5 req-62cd1e33-9d5c-48a6-a8c8-1747576bd06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be489d1a-8da6-4c45-8917-826eab40d642", "tag": "e4f9ade5-936a-44fc-81c2-05d1059b8111"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:53.843107 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e082432f-9c78-4393-8088-55370bb94cc5 req-62cd1e33-9d5c-48a6-a8c8-1747576bd06d service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:53.843775 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e082432f-9c78-4393-8088-55370bb94cc5 req-62cd1e33-9d5c-48a6-a8c8-1747576bd06d service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:53.844522 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-e082432f-9c78-4393-8088-55370bb94cc5 req-62cd1e33-9d5c-48a6-a8c8-1747576bd06d service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:53.875699 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-e082432f-9c78-4393-8088-55370bb94cc5 req-62cd1e33-9d5c-48a6-a8c8-1747576bd06d service nova] Creating event network-changed:e4f9ade5-936a-44fc-81c2-05d1059b8111 for instance be489d1a-8da6-4c45-8917-826eab40d642 on hv-cinder-85391 Aug 25 05:35:53.899725 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-e082432f-9c78-4393-8088-55370bb94cc5 req-62cd1e33-9d5c-48a6-a8c8-1747576bd06d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303162 Aug 25 05:35:53.901122 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 620/1243] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:35:53.972382 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-6a824def-ae64-4097-9eb3-74bf19871ff9 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 204 len: 0 microversion: 2.1 time: 0.365201 Aug 25 05:35:53.975203 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 624/1244] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Aug 25 05:35:53 2022] DELETE /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 05:35:53.998025 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:53.999172 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:54.010882 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:54.011965 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:54.013190 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:54.014376 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:54.015130 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:54.015803 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:54.243763 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:54.252272 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-42180bc2-c24c-4ea4-a007-0c9b4064b2f4 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.263819 Aug 25 05:35:54.252927 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 621/1245] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:53 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:55.276564 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:55.277267 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:55.284375 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:55.284844 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:55.285265 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:55.285986 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:55.286427 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:55.286841 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:55.423542 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:55.431566 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-feb99d80-d8c3-49c6-abd6-df1ebc90bbfe tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1567 microversion: 2.1 time: 0.159883 Aug 25 05:35:55.432173 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 625/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:55 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:56.367923 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [req-f3c7a898-ae59-4904-b85c-3805599c64ea req-732d55ce-3b52-4fd6-9fde-56def1e28c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be489d1a-8da6-4c45-8917-826eab40d642", "name": "network-vif-deleted", "tag": "e4f9ade5-936a-44fc-81c2-05d1059b8111"}]} {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 05:35:56.377391 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-f3c7a898-ae59-4904-b85c-3805599c64ea req-732d55ce-3b52-4fd6-9fde-56def1e28c8e service nova] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:56.379121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-f3c7a898-ae59-4904-b85c-3805599c64ea req-732d55ce-3b52-4fd6-9fde-56def1e28c8e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:56.379121 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [req-f3c7a898-ae59-4904-b85c-3805599c64ea req-732d55ce-3b52-4fd6-9fde-56def1e28c8e service nova] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:56.388981 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.compute.server_external_events [req-f3c7a898-ae59-4904-b85c-3805599c64ea req-732d55ce-3b52-4fd6-9fde-56def1e28c8e service nova] Creating event network-vif-deleted:e4f9ade5-936a-44fc-81c2-05d1059b8111 for instance be489d1a-8da6-4c45-8917-826eab40d642 on hv-cinder-85391 Aug 25 05:35:56.393629 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [req-f3c7a898-ae59-4904-b85c-3805599c64ea req-732d55ce-3b52-4fd6-9fde-56def1e28c8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029317 Aug 25 05:35:56.394537 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 622/1247] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Aug 25 05:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 05:35:56.452431 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:56.453763 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:56.459532 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:56.460009 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:56.460440 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:56.461127 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:56.461607 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:56.462144 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:56.524385 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.policy [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121314) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:56.532783 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-686e6865-b6e5-44a6-be2a-63af292a4dae tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1381 microversion: 2.1 time: 0.084289 Aug 25 05:35:56.533342 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 626/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:56 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1381 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:57.555123 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:57.555816 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.compute.api [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121310) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:57.562658 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:57.563131 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:57.563556 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:57.564304 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:57.564750 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:57.565676 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:57.596631 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:57.597094 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:57.597519 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG oslo_concurrency.lockutils [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121310) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:57.597976 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.objects.instance [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lazy-loading 'fault' on Instance uuid be489d1a-8da6-4c45-8917-826eab40d642 {{(pid=121310) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 05:35:57.639685 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.policy [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a77b0db996b4bd58f2a92344a26fe78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad667fe8d4b6582a7e4340ecfe33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121310) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 05:35:57.647441 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-e2a205a9-62c6-4245-9bc5-cafa709f6d1e tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 200 len: 1224 microversion: 2.1 time: 0.096908 Aug 25 05:35:57.647921 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 623/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:57 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 05:35:58.669550 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '>' {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:58.670194 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.compute.api [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] [instance: be489d1a-8da6-4c45-8917-826eab40d642] Fetching instance by UUID {{(pid=121314) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 05:35:58.676018 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:58.676490 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:58.676913 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:58.677581 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Acquiring lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 05:35:58.678052 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 05:35:58.678492 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG oslo_concurrency.lockutils [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Lock "2f327c0d-26cd-440b-94ed-9780c2c19efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121314) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 05:35:58.691951 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.wsgi [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] HTTP exception thrown: Instance be489d1a-8da6-4c45-8917-826eab40d642 could not be found. Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Request method failure captured: Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: request: GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 HTTP/1.1 Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept: application/json Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Accept-Encoding: identity Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Connection: close Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Length: 0 Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Content-Type: application/json Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Host: 10.222.0.16 Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: Openstack-System-Scope: None Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: User-Agent: python-urllib3/1.26.11 Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Auth-Token: gAAAAABjBwj4CIFOeKOsMrtzNAsENTtYoC3m5K_RsVpFTnPZ8PAKcaW-HbBrVFo-QB0K7AtnaPfxsLJLL7boDP3I48gNCg2-vP9WexrYv6zgcfaTjFBGxqRyhxYrVJ19ZpdiPQieZ7qV2yDcIVffbwAHr9eLPeZwPRYgoolO_TObqxDstyv4_Rs Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Id: None Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Domain-Name: None Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Identity-Status: Confirmed Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Is-Admin-Project: True Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Id: default Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Domain-Name: Default Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Id: 52aad667fe8d4b6582a7e4340ecfe33f Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Project-Name: tempest-TestShelveInstance-1776990115 Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Role: member,reader Aug 25 05:35:58.693569 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Roles: member,reader Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52aad667fe8d4b6582a7e4340ecfe33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_52aad667fe8d4b6582a7e4340ecfe33f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/52aad667fe8d4b6582a7e4340ecfe33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52aad667fe8d4b6582a7e4340ecfe33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant: tempest-TestShelveInstance-1776990115 Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Id: 52aad667fe8d4b6582a7e4340ecfe33f Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-Tenant-Name: tempest-TestShelveInstance-1776990115 Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User: tempest-TestShelveInstance-1776990115-project Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Id: default Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Domain-Name: Default Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Id: 8a77b0db996b4bd58f2a92344a26fe78 Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: X-User-Name: tempest-TestShelveInstance-1776990115-project Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: method: > Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: exception: Instance be489d1a-8da6-4c45-8917-826eab40d642 could not be found. Aug 25 05:35:58.695366 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: action_args: {'id': 'be489d1a-8da6-4c45-8917-826eab40d642'} Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: {{(pid=121314) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be489d1a-8da6-4c45-8917-826eab40d642 could not be found. Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 05:35:58.696410 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be489d1a-8da6-4c45-8917-826eab40d642 could not be found. Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be489d1a-8da6-4c45-8917-826eab40d642 could not be found. Aug 25 05:35:58.698724 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: ERROR nova.api.openstack.wsgi Aug 25 05:35:58.700362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: DEBUG nova.api.openstack.wsgi [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Returning 404 to user: Instance be489d1a-8da6-4c45-8917-826eab40d642 could not be found. {{(pid=121314) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 05:35:58.700362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: INFO nova.api.openstack.requestlog [None req-fe20485a-7776-46a7-ae9b-0d4420ffb321 tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642" status: 404 len: 111 microversion: 2.1 time: 0.030676 Aug 25 05:35:58.700362 dv-cinder-853910-2-iscsi devstack@n-api.service[121314]: [pid: 121314|app: 0|req: 627/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Aug 25 05:35:58 2022] GET /compute/v2.1/servers/be489d1a-8da6-4c45-8917-826eab40d642 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 05:35:58.909740 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: DEBUG nova.api.openstack.wsgi [None req-677f6049-3013-4bb0-84c9-1aa42106063a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] Calling method '.version_select at 0x7f2423c415e0>' {{(pid=121310) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 05:35:58.985843 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: INFO nova.api.openstack.requestlog [None req-677f6049-3013-4bb0-84c9-1aa42106063a tempest-TestShelveInstance-1776990115 tempest-TestShelveInstance-1776990115-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1545764982" status: 202 len: 0 microversion: 2.1 time: 0.080527 Aug 25 05:35:58.986430 dv-cinder-853910-2-iscsi devstack@n-api.service[121310]: [pid: 121310|app: 0|req: 624/1251] 10.222.0.16 () {58 vars in 1254 bytes} [Thu Aug 25 05:35:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1545764982 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)